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Digital signal coding and decoding methods and apparatuses and programs therefor 



(57) At the coder side, bits of samples of each frame 
of an input digital signal are concatenated every digit 
common to the samples across each frame to generate 
equi-order bit sequences, which are output as packets. 
At the decoding side, the input equi-order sequences 
are arranged inversely to their arrangement at the coder 



side to reconstruct sample sequences. When a packet 
dropout occurs, a missing information compensating 
part 430 correct the reconstructed sample sequences 
in a manner to reduce an error between the spectral en- 
velope of the reconstructed sample sequence con- 
cerned and a known spectral envelope. 
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Description 

BACKGROUND OF THE INVENTION 

5 [0001] The present i n vention relates to coding and decoding methods for reducing the number of bits that represent 
various digital signals such as an acoustic signal and an image signal and apparatuses and programs therefor, partic- 
ularly, to those capable of controlling allowable distortion. 

[0002] To compress audio and visual information, there are proposed an irreversible distortion-prone or lossy coding 
scheme, and a distortion-free or lossless coding scheme. For irreversible compression coding (or lossy compression 

10 coding), there are several well known schemes such as ITU-T (International Telecommunications Union — Telecom 
Standardization) and ISO/IEC MPEG (International Organization for Standardization/International Electrotechnical 
Commission Moving Picture Experts Group) standard schemes. With these irreversible compression coding schemes, 
it is possible to compress the original digital signal down to 1/1 0 or less with a little loss of signal data. However, the 
loss depends on the coding condition or the input signal, and may sometimes lead to degradation of the reconstructed 

15 signal. 

[0003] On the other hand, a known reversible compression coding (or lossless compression coding) scheme capable 
of completely reconstructing the original signal is a universal compression coding scheme for to compressing data files 
and texts of computers. This compression coding scheme is able to compress any type of signats while learning the 
statistics of the input sequence; tests or the like can be compressed down to approximately 1/2, but in the case of 
20 audio and visual data, their compression ratio is only about 20%. 

[0004] A combination use of high-compression -ratio irreversible coding and reversible compression of an error be- 
tween the reconstructed and the original signal, flexible use either the high-compression-ratio irreversible coding or 
allows the reversible compression coding as required. 

[0005] The inventor of the present application has proposed the above combined compression coding scheme in 
25 Japanese Patent Application Laid-Open Gazette No. 44847/01 "Coding Method, Decoding Method and Apparatuses 
Therefor and Recording Media Having Recorded Thereon Programs Therefor." While described in detail in the above 
gazette, the combined compression coding scheme will be described below in brief with reference to Fig. 1 . 
[0006] In a coder 1 0, a digital input signal (hereinafter referred to also as an input signal sample sequence) is input 
via an input terminal 1 0O, and in a frame separation part 1 00 the input signal sample sequence is separated Into frames 
30 each consisting of, for example, 1024 input signal samples. 

[0007] In an irreversible quantization part 120 the output from the frame forming part 110 is subjected to irreversible 
compression coding. This coding may be of any scheme suited to the digital input signal as long as it enables the input 
signal to be reconstructed to some extent when It is decoded. For example, when the input signal is a speech signal, 
ITU-T speech coding or the like can be used; in the case of music, MPEG or TwinVQ (Transform -Do main Weighted 
35 Interleaved Vector Quantization) can be used; and in the case of video, MPEG or the like can be used. Further, various 
irreversible quantization schemes mentioned in the above-mentioned Japanese gazette can also be employed. Inci- 
dentally, the output from the irreversible quantization part 120 will hereinafter be referred to as an "irreversibly com- 
pressed code l(n)." 

[0008] In an inverse quantization part 130 of the same configuration as that of a decoding part (i.e. an inverse quan- 
40 tization part 230) corresponding to the irreversible quantization part 120, a locally reconstructed signal is generated 
from the irreversibly compressed code l(n). An error signal between the locally reconstructed signal and the original 
digital input signal is calculated in a subtraction part 140. Usually the amplitude of the error signal is appreciably smaller 
than the amplitude of the original digital input signal. Accordingly, as compared with reversibly compression coding of 
the digital input signal as it is, reversible compression coding of the error signal permits reduction of the amount of 
45 information. 

[0009] To increase the efficiency of the reversible compression coding, a rearrangement part 1 60 rearranges bits of 
the error signal (i . e. a b it sequence or stream) . The details of processing by the reanangement part 1 60 will be described 
below with reference to Fig. 2. In the digital input signal (Fig. 2A) a positive or negative integer of each sample value 
(amplitude) is represented using a 2's complement format. Error signal samples between the digital input signal and 

50 the corresponding locally reconstructed signal are shown in Fig. 2B. The rearrangement part 160 converts the error 
signal (that is, a b it seq uence) from a bit sequence of the 2's complement format to a bit sequence of a sign-magnitude 
format (a binary number of sign and magnitude) (Fig. 2C). In the converted error signal, MSB (Most Significant Bit) to 
a second LSB (Least Significant Bit) represent the magnitude of its amplitude and LSB the sign of the amplitude. 
[0010] Next, in the rearrangement part 160 the error signal samples converted to the sign-magnitude format are 

55 combined at their respective corresponding bit positions (i.e., MSB, second MSB, LSB), successively in a temporal 
order in Fig. 2 (Fig . 2D) . Each of these bit seq uences (e.g. , consisting of 1 024 bits at the same bit position) will hereinafter 
be referred to as a "equi-position bit sequence." In the above rearrangement the value of each error signal remains 
unchanged. Since the error signal is small in amplitude, however, high-order bits all become "0s" frequently. As a result, 
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a sequence of "0s" prov ides enhanced efficiency in the reversible compression coding of the error signal. 
[0011] Next, the output from the rearrangement part 160 is subjected to reversible compression coding in a reversible 
coding part 150. The reversible coding part 150 performs the reversible compression coding of the equi-position bit 
sequences by entropy coding which utilizes, for example, the presence of a consecutive sequence or a frequent- 
5 occurrence sequence, such as Huffman coding or arithmetic coding, the coded equi-position bit sequences being 
provided to a decoder 20. The compression efficiency will be increased as well by applying to the output from the 
rearrangement part 160 universal coding that reversibly compresses a text or the like. 

[0012] As the result of the above processing, the coder 10 outputs the irreversibly compressed code l(n) from the 
irreversible quantization part 120 and the reversibly compressed code l(e) from the reversible coding part 150. 

10 [0013] In the decoder 20 a decoding "part 210 decodes the reversibly compressed code l(e): And a rearrangement 
part 220 sequentially outputs the error signals for each frame by performing processing reverse to that of the rear- 
rangement part 160. Trie inverse quantization part 230 decodes the irreversibly compressed code l(n). An addition 
part 240 adds the outp uts from the inverse quantization part 230 and the rearrangement part 160. Finally, a frame 
combining part 250 sequentially outputs the output signal from the addition part 240 to reconstruct the original input 

15 signal sample sequence, which Is provided at an output terminal 260. 

[0014] The conventio nal reversible compressing coding scheme presents a problem that when a bit erasure occurs 
during transmission, each sample to be reconstructed by the rearrangement part of the decoder 20 gets mixed with 
bits of other samples, seriously degrading the reconstructed signal quality. This prior art scheme provides a compres- 
sion ratio of approximately 1/2 at the highest and cannot achieve a 1/3 or 1/4 compression ratio with no substantial 

20 deterioration of quality n or can it implement comp ression with a satisfactory accuracy. 

[0015] Moreover, even if the number of bits of the digital value representing the amplitude of the original signal is 
reduced by one bit, it is possible to restore the orig inal waveform with the same accuracy as that with no bit reduction, 
but reducing four or mo re bits raises an auditory-sensation problem that high quantization noise is noticeable. 

25 SUMMARY OF THE IN VENTION 

[0016] It is therefore sn object of the present invention to provide coding and decoding methods which prevent a bit 
erasure during transmission from leading to serious degradation of the decoded signal quality and apparatuses which 
embody the methods. 

30 [0017] A coding methi od according to the present invention comprises the steps of: 

(a) generating multiple sets of data either consisting of multiple sets of lossless data of bits over said samples at 
each one of bit pos itions of said digital signal i n said frame or consisting of lossy data and lossless data of an error 
signal due to said I ossy data; and 
35 (b) coding said mu Itiple sets of data to produce codes. 

[0018] A decoding method according to the present invention comprised the steps of: 

(a) decoding input codes to produce multiple sets of data either consisting of multiple sets of lossless data of bits 
40 over said samples at each one of bit positions of said digital signal in said frame or consisting of lossy data and 

lossless data of an error signal due to the lossy data; and 

(b) reconstructing a digital signal based on said multiple sets of data. 

[0019] A coder for coding a digital signal for each frame according to the present invention comprises: 

45 

means for generating multiple sets of data either consisting of multiple sets of lossless data of bits over said 
samples at each o ne of bit positions of said digital signal in said frame or consisting of lossy data and lossless 
data of an error sig nal due to said lossy; and 
means for coding said multiple sets of data to produce codes. 

50 

[0020] A decoder wh i ch reconstructs a sequence of samples of a digital signal for each frame according to the present 
invention comprises: 

means for decodin g input codes to produce multiple sets of data either consisting of multiple sets of lossless data 
55 of bits over said samples at each one of bit positions of said digital signal in said frame or consisting of lossy data 

and lossless data of an error signal due to the lossy data; and 
means for reconstructing a digital signal based on said multiple sets of data. 
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[0021] According to the coding method of the present invention, each piece of transmission/recording unit data is 
put in packet form, and hence, even if the amount of information is reduced by intentionally erasing the packet in 
accordance with the chan nel capacity or storage capacity during coding, the decoding method of the present invention 
enables the transmission/recording unit data to be> compensated for the packet erasure. 

s [0022] In this specification, the packet erasure refers to the cases: where all packets of one frame are not input to 
the decoder because of intentionally removing packets of one frame so as to control the amount of information; where 
a packet erasure occurs because a router or the I ike does not send out some packets due to traffic congestion in a 
communication network: or due to transmission line failure or abnormality of a recording/playback unit; and where 
because of an error in the input packet the transrn ission/recording unit data concerned cannot be decoded nor can it 

10 be used. 

BRIEF DESCRIPTIN O F THE DRAWINGS 
[0023] 

15 

Fig. 1 is a block diagram illustrating functional configurations of a coder and a decoder in the prior art 
Figs. 2A to 2D are diagrams for explaining processing of a rearrangement part 160 in Fig. 1; 
Fig. 3 is a block diag ram illustrating the function al configuration of a coder and a decoder according to Embodiment 
1 of the present invention; 
20 Fig. 4A is a diagram showing an example of processing of the rearrangement part 160; 

Fig. 4B is a diagram showing an example of trie format of a packet; 

Fig. 5 is a graph showing an example of comparison between the original sound and a distortion component in 
association with processing by a missing information compensating correcting part 430; 

Fig. 6 is a block diagram illustrating functional configurations of a coder and a decoder according to Embodiment 
25 2 of the present invention; 

Fig. 7 is a flowchart showing an example of a procedure by the missing information compensating part 430 in the 
case of using auxiliary information; 

Fig. 8 is a block diag ram corresponding to Fig. T, depicting an example of the functional configuration of the missing 
information compensating part 430; 
30 Fig. 9 is a flowchart showing another example of the procedure by the missing information compensating part 430 

in the case of using auxiliary information; 

Fig. 10 is a block diagram illustrating the functional configuration of a concrete example of a composite spectral 
envelope calcu latin g part 437; 

Fig. 11 is a block diagram illustrating a coder and a decoder according to Embodiment 3 of the present invention; 
35 Fig. 12 is a block diagram illustrating a modified form of the decoder according to Embodiment 3; 

Fig. 13A is a graph showing SNR of a decoded signal according to computer simulation for explaining the effect 
of the present invention; 

Fig. 13B is a graph showing cepstrum distance between a decoded signal and an original signal according to 
computer simulatio n for explaining the effect of the present invention; 
40 Fig. 14 is a block diagram illustrating a coder and a decoder according to Embodiment 4 of the present invention; 

Fig. 15A is a diagram showing an example of processing by the rearrangement part 160; 

Fig. 1 5B is a diagram showing an example of p rocessing of a 2's complement value by the rearrangement part 1 0; 
Fig. 16 is a flowchart showing another example of the procedure by the missing information compensating part 
430 in the case of using auxiliary information; 
45 Fig. 17 is a block diagram corresponding to Fig. 16, illustrating an example of the functional configuration of the 

missing information compensating part 430; 

Fig. 18 is a flowchart showing another example of the procedure by the missing information compensating part 
430 in the case of using auxiliary information ; 

Fig. 1 9 is a block di agram illustrating a coder and a decoder according to Embodiment 5 of the present invention; 
so Fig. 20 is a block diagram illustrating a modified form of the decoder according to Embodiment 5; 

Fig. 21 is a block diagram illustrating a coder and a decoder according to Embodiment 6 of the present invention; 
Fig. 22 is a flowchart showing another example of the procedure by the missing information compensating part 
430 in the case of using no auxiliary information; 

Fig. 23 is a block diagram corresponding to Fig. 22, illustrating the functional configuration of the missing informa- 
55 tion compensating part 430; 

Fig. 24 is a flowchart showing another example of the procedure by the missing information compensating part 
430 in the case of using auxiliary information ; 

Fig. 25 is a block diagram corresponding to Rig. 24, illustrating an example of the functional configuration of the 
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missing information compensating part 430; 

Fig. 26 is a flowchart showing another example of the procedure by the missing information compensating part 
430 in the case of using auxiliary information ; 

Fig. 27 is a block diagram illustrating an example of the functional configuration of Embodiment 7 of the present 
s invention; 

Fig. 28A is block diagram depicting a concrete example of a modified parameter generating part 17; 

Fig. 28B is a block diagram depicting another concrete example of the modified parameter generating part 17; 

Fig. 29 is a block diagram illustrating an example of the functional configuration of Embodiment 8 of the present 

invention; 

10 Fig. 30 is a is a blocK diagram illustrating an example of the functional configuration of Embodiment 9 of the present 

invention; 

Fig. 31 is a block diagram illustrating an example of the functional configuration of Embodiment 10 of the present 
invention; 

Fig. 32 is a block diagram illustrating an example of the functional configuration of Embodiment 11 of the present 
15 invention; 

Fig. 33 is a block diagram depicting an example of the functional configuration of a reversible coding part 18 in 
Fig. 32; 

Fig. 34 is a block diagram depicting an example of the functional configuration of a reversible decoding part 21; 
Fig. 35A is a block d i agram depicting an other example of the functional configuration of a reversible coding part 1 8; 
20 Fig. 35B is a block diagram depicting an other example of the functional configuration of a reversible decoding 

part 21; 

Fig. 36 is a block di agram illustrating an example of the functional configuration of Embodiment 12 of the present 
invention; 

Fig. 37 is a block diagram illustrating a modified form of Embodiment 12; 
25 Rg. 38 is a block di agram illustrating an example of the functional configuration of Embodiment 13 of the present 

invention; 

Fig. 39 is a block diagram illustrating an example of the functional configuration of Embodiment 14 of the present 
invention; 

Fig. 40 is a block di agram illustrating an example of the functional configuration of Embodiment 15 of the present 
30 invention; 

Fig. 41 is a block diagram illustrating an example of the functional configuration of Embodiment 16 of the present 
invention; 

Fig. 42 is a diagram showing an example of an accuracy-guaranteed locally reconstructed signal 11; 
Fig. 43A is a diagram showing another example of the accuracy-guaranteed locally reconstructed signal 11 ; 
35 Fig. 43B is a diagram showing an example of a code group including an exception code Ige and a digit number 

code Ig; and 

Fig. 44 is a block di agram illustrating an example of the functional configuration of Embodiment 1 7 of the present 
invention. 

40 DETAILED DESCRIPTI ON OF THE PREFERRE D EMBODIMENTS 

[0024] Referring to the accompanying drawings, embodiments of the present invention will hereinafter be described. 
The parts corresponding to those previously described in respect of the prior art will be identified by the same reference 
numerals as those used therefor. 

45 

EMBODIMENT 1 

[0025] In Fig. 3 there are depicted in block form the coder 10 and the decoder 20 according to this embodiment of 
the present invention. This embodiment differs from the Fig. 1 prior art example in the provision of a header adding 
so part 320, which sends out signals in a packet to reduce the influence of a bit error during transmission on the quality 
of reconstructed signal. 

[0026] In the coder 1 0 an input signal sample sequence from an input terminal 100 is separated by a frame forming 
part 110 into frames each consisting of, for example, 1024 input signal samples (that is, n=samples at 1024 sample 
points), and in the rearra ngement part 1 60 bits at each bit position in amplitude bit sequences of the respective samples 
55 are formed in the frame. In this case, the amplitude of the input signal sample sequence is represented by a positive 
or negative integer in the 2's complement format; it is preferable that as is the case with the prior art each sample 
represented in the 2's complement format be converted to an m-bit binary format consisting of a sign bit and absolute 
value in a sign-magnitude conversion part 161 and that m-bit samples of each frame be converted to bit sequences 
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• 



each formed by sequential bits at each bit positions of the respective m-bit samples over the entire frame in a bit 
sequence converting part 162, which bit sequences will hereinafter be referred to equi-position bit sequences. As 
indicated by the broken I ine in Fig. 3, however, the output from the frame separation part 1 00 may be fed directly to 
the bit sequence conversion part 162, wherein bits at each of the bit positions are concatenated in the frame to form 

5 equi-position bit sequences. 

[0027] In the present i mvention : the equi-position bit sequences from the rearrangement part 160 are provided to a 
transmission/recording u nit separation part 31 0, wh erein they are each separated to transmission or storage unit data. 
This unit will hereinafter be referred to as a block and also as a packet. Each piece of the transmission/recording unit 
data separated is reverse ibly compressed in a reversible coding part 150, if necessary. In the header adding part 320 

10 a header containing ase rial number, for instance, is im parted to each piece of the reversibly compressed transmission/ - 
recording unit so that du ring decoding the separated pieces of transmission recording data may be reconstructed as 
one frame, and the unit cdata is provided as a packet to an output terminal 170. Incidentally, the reversible coding part 
150 is similar to that 150 used in the prior art example. 

[0028] An ordinary inp ut signal sample represents a positive or negative integer in the 2's complement format, but 

15 in this example, bits of numerical value sequences of every frame after conversion of the digital input signal to the 
binary format consisting of the sign bit and absolute value are rearranged, that is, converted to the equi-position bit 
sequences and they are separated into transmissi on/recording unit data as shown in Fig. 4A. The respective m-bit 
samples of one frame in & sign-magnitude format are sequentially arranged in a temporal order as depicted at the left- 
hand side of Fig. 4A. For the sake of better understanding of the amplitude bit sequence of an n-th sample, it is shown 

20 as a thick-lined amplitude bit sequence DV{n) : where n represents the sample number in a temporal order in the frame; 
for example, n=1, 2 : 1 024. As will be described, for example, in case where input data is a speech signal, if a bit is 
lost due to a packet eras ure on the transmission line, the reconstructed speech quality is distorted more seriously the 
higher-order the bit is in the amplitude bit sequence DV(n). In this instance, the sign bit distorts the speech quality most 
seriously; hence, in this example, the sign bit of each amplitude bit sequence DV(n) is placed adjacent to the MSB of 

25 the absolute value, and i n Fig. 4A it is placed right above MSB. 

[0029] In this example , as shown on the right-hand side of Fig. 4A, only sign bits (signs) of amplitude values of the 
respective samples are -first concatenated in a temporal order to form equi-position bit sequences in the frame. Next, 
only MSBs of the amplitude values are concatenated in the frame to form an equi-position bit sequence. Thereafter, 
bits at each of other bit positions are similarly concatenated across the frame to form equi-position bit sequences. 

30 Finally, only LSBs are concatenated in the frame to form an equi-posrtion bit sequence. An example of such equi- 
position bit sequences is indicated by a thick-lined frame DH(i), where i represents each bit position in the equi-position 
bit sequence DV(n); for example, i=1, 2, .... 17, counted from the MSB. In the above rearrangement, the contents 
included in the frame remain unchanged. 

[0030] In the transmission/recording unit separation part 310 each equi-position bit sequence DH(i) or adjacent plural 
35 equi-position bit sequences DH(i) are separated into pieces of transmission/recording unit data. In this case, transmis- . 
sion/recording unit data -formed by one equi-position bit sequence and transmission/recording unit data by plural equi- 
position bit sequences may be interleaved in one frame. 

[0031] Each piece of thi e transmission/recording u nit data is provided to the header adding part 320, wherein a header 
32 is added to the transmission/recording unit data (payload) 32 as shown in Fig. 4B, for instance. The header 31 
40 contains a packet number 33 consisting of, for exam pie, a frame number and the number of the transmission/recording 
unit data in the frame, and if necessary, the priority level 34 of the packet and the data length 35, enabling the decoder 
side to reconstruct the cJ igital signal sequence for each frame accordingly. 

[0032] Transmission of data length 35 is not necessary if the data length of the transmission/recording unit data is 
fixed. When it is compressed in the reversible coding part 150, the data length may, however, sometimes differ with 
45 packets. 

[0033] In general, an error detecting code 35 for detecting an error in the packet, such as a CRC code, is added to 
the end of the payload 32 to form one packet 30, which is provided to the output terminal 170. 

[0034] In the case of assigning priorities to the packets 30, codes representing higher priorities are given to packets 
containing transmission/' recording unit data corresponding to higher-order bit positions of the amplitude bit sequence. 

50 That is, when each equ i -position bit sequence DH(i) is separated, the packet containing data of smaller i in DH(i) is 
given a higher priority. In the example of Fig. 4A, trie sign amplitude bit sequence DH(1) containing the sign bit corre- 
sponding to i=1 is given t he highest priority. The amplitude bit sequences for the LSBto MSB can be assigned priorities 
in an increasing order: in stead it is also possible to assign different priority levels to, for example, plural high-order bits 
and a common lower level priority to plural low-orde>r bits. The number of priority levels assigned to the bit sequences 

55 can be smaller than the number of the bit sequences. In the case of using the reversible compression coding in com- 
bination with the high-co repression irreversible quantization as described previously with reference to the prior art : the 
highest priority level ma^y be given to the bit sequence representing the high-compression encoded code as will be 
described. 
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[0035] In the decoder SO, when the packet 30 input via an input terminal 200 has its transmission/recording unit data 
reverslbly compressed, t he packet 30 is reversibly decoded in a reversible decoding part 210 (identical with the con- 
ventional decoding parts 10), and in a transmission/recording unit assembling part 410; based on the packet numbers, 
pieces of transmission/recording unit data of respective packets 30 are assembled every frame, for example, as indi- 

s cated by the equi-positio n bit sequence DH(i) on the right side of Fig. 4A. The assembled equi-position bit sequence 
is fed to a data rearrang ement part 220, wherein they are converted to an amplitude bit sequence DV(n), that is, a 
sample sequence (wave*f orm sample sequence). In this case, when each sample is represented by the amplitude value 
in a sign-absolute value format, the equi-position bit sequences are rearranged to amplitude bit sequences in a bit 
sequence conversion pa r-t 221 , after which each amplitude bit sequence is converted to a 2*s complement binary format 

10 in a 2's complement conversion part 222. Incidentally, when the transmission/recording unit data is based on a equi- 
position bit sequence directly rearranged from an amplitude bit sequence in the 2's complement format, the amplitude 
bit sequence from the bit: sequence conversion part 221 is provided as a decoded sample to a frame combining part 
250 as indicated by the tsroken lines in Fig. 3. 

[0036] In the present i nvention, if the occurrence of an erasure in a series of packet numbers of the input packets is 

is detected in an erasure d etecting part 420, which decides that the packets of the packet numbers are missing, and the 
amplitude bit sequences from the rearrangement part 220 are not provided directly to the frame combining part 250, 
instead they are fed to t he missing information compensating part 430, wherein they are compensated for missing 
information, after which the amplitude bit sequences are provided to the frame combining part 250. 
[0037] The compensation for missing information in the missing information compensating part 430 is made by es- 

20 timating the missing info rmation from known information. When a packet that usually contains a bit near the LSB side 
and hence lower in priori ty fails to transmit, since the value of the bits corresponding to the missing portion cannot be 
determined, the waveform has to be reconstructed using a small numerical value, for example, 0 or an intermediate 
value that the missing portion can take. Although the accuracy of a determined number of bits on the MSB side can 
be retained, but the bit e rasure results in large perceptual distortion for the reasons given below. The spectrum of the 

25 original sound leans in energy toward the low frequency range as indicated by the solid line in Fig. 5, whereas the 
distortion component by the bit erasure has a nearly flat spectral shape as indicated by the broken line and its high- 
frequency component is larger than in the original sound and heard as noise. To solve this problem, the value of 
uncertain waveform is co rrected so that the spectrum of the uncertain component becomes close to an average spec- 
trum or a spectrum dete> rmined for each frame. This reduces the high-frequency component of the spectrum of the 

30 distortion component after correction as indicated by the one-dot chain line in Fig. 5, masking the distortion by the 
original sound and hence improving quality. 

[0038] That is : when an average spectrum of several preceding frames or a determined spectrum in a separately 
obtained frame to be described is close to the solid-lined spectrum in Fig. 5, for instance, compensation is made for 
the missing information so that a spectrum available from information other than the missing information of the current 

35 frame goes close to the* solid-line spectrum in Fig. 5. A preferable correction scheme will be described later on in 
connection with another embodiment. A simple scheme is to remove a noise component in the high-frequency range 
by smoothing the input reconstructed sample sequence by low-pass filter in the erasure correction part 430. The cut- 
off characteristics of the low-pass filter is so chosen as to attenuate the high-frequency component according to the 
characteristics if the spectral envelope of the original signal is known. Alternatively, the cut-off characteristics may be 

40 adaptively changed acc ording to the shape of an average spectrum obtained as mentioned above or a determined 
spectrum of each frame . 

[0039] Since missing i nformation resulting from a packet erasure can be compensated for in the decoder 20 as 
described above, even i"F the coding compression efficiency is increased by intentionally refraining from sending the 
LSB side packets as req uired, it is possible for the decoder 20 to perform decoding or reconstruction with perceptually 
45 lossless quality. 

EMBODIMENT 2 

[0040] Fig. 6 illustrates in block form a second embodiment of the present invention. In the coder 1 0 the input signal 
so sample sequence separated for each frame in the frame forming part 110 is provided to an auxiliary information gen- 
erating part 350. The au miliary information generati ng part 350 comprises a spectral envelope calculating part 351 , a 
power calculating part 354 and an auxiliary information coding part 352. The input signal sample sequences separated 
in the frame forming pare 110 for each frame are provided to the spectral envelope calculating part 351 , wherein coef- 
ficients representing the spectral envelope are calculated, for example, as linear prediction coefficients LPC by linear 
55 predictive analysis, and ■ n the power calculating part 354 the average power Pa of the input signal sample sequences 
for each frame is calculated. 

[0041] Alternatively, th e input signal sample sequences are input to an inverse filter 355 formed based on the linear 
prediction coefficients L PC, wherein their spectral envelopes are flattened, and the average power of the flattened 
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signals is calculated in a power calculating part 356. The linear prediction coefficients LPC and the average power Pa 
are fed to the auxiliary information coding part 352, wherein they are encoded with low bits such as 30 to 50 bits to 
provide auxiliary informaction. The auxiliary information is provided to the header adding part 320, wherein it is added 
' _ to a representative packet of each frame, for example, a packet containing the transmission/recording unit data includ- 
5 ing the sign bit; alternatively, it is output as an independent packet. 

[0042] Incidentally, sin«se an increase in the frame length will not cause an considerable change in the spectral en- 
velope parameter calculated in the spectral envelope calculating part 351 nor will it produce a significant change in 
the amount of informatio n of the spectral envelope coefficients encoded in the auxiliary information coding part 352, 
the digital input signal to foe applied to the rearrangement part 1 60 is separated by a frame forming part 110' for a frame 
10 length longer than its fra*rie length and then provided to the auxiliary information generating part 350 to enhance the 
efficiency of reversible compression as indicated by the broken lines in Fig. 6. 

[0043] In the decoder 20, the packet input to the input terminal 200 is fed to a separation part 440, wherein it is 
separated into the transmission/recording unit data and the auxiliary information. The transmission/recording unit data 
is provided to the decodi rg part 210, and the auxiliary i nf ormation is provided to an auxiliary information decoding part 

is 450, which decodes the parameter representing the spectral envelope of the frame concerned. That is, the linear 
prediction coefficients LF*C and the average power Pa, are provided to the missing information compensating part 430. 
The missing information compensating part 430 uses the spectral envelope coefficients LPC and the average power 
Pa to compensate for mi ssing information as described previously in connection with Embodiment 1 . 
[0044] Alternatively, each potential combination of values as the missing information (bit) are added to each sample 

20 value to obtain candidates for a compensated sample sequence (waveform), then spectral envelopes of these candi- 
dates are calculated, and that one of the candidates fo r the compensated sample sequence (waveform) whose spectral 
envelope is the closest to the decoded spectral envelope of the auxiliary information is provided as a compensated 
sample sequence to the -frame combining part 250. Incidentally, the reversible coding part 150 and the decoding part 
210 in Fig. 6 may be omitted. 



25 



Compensation based ort auxiliary information 



[0045] In the case of p reducing the candidates for the compensated sample sequence by use of each combination 
of possible values for th& missing information, an increase in the amount of missing information (bit) causes a consid- 
30 erable increase in the number of candidates, giving rise to a problem that is computational complexity. A description 
will be given below of the processing by the missing inf ormation compensating part 430 and its functional configuration 
that will overcome such & problem. 

[0046] Fig. 7 depicts an example of the procedure to be followed and Fig. 8 an example of the functional configuration 
of the missing informatio n compensating part. In the first place, only determined bits input to a provisional waveform 
35 generating part 431 from the rearrangement part 220 are used to reconstruct a provisional waveform (a provisional 
sample sequence) in the frame (S1). The provisional waveform is generated with the missing bit fixedly set to, for 
example, 0 or an intermediate value of the missing bit between the maximum and the minimum. For example, if low- 
order four bits are missing, their values are any one of 0 to 15; provisionally, it is set to 8 or 7. 

[0047] Next, the spect ral envelope coefficients of the provisional waveform are calculated in a spectral envelope 
40 calculating part 432 (S2) - The spectral envelope coefficients can be estimated by subjecting the provisional waveform 
to an all-pole-type linear predictive coding analysis used in speech analysis, for instance. On the other hand, received 
auxiliary information Ax is decoded in the auxiliary information decoding part 450 to provide the spectral envelope 
coefficients of the original sound, and in an error calculating part 433 the spectral envelope coefficients of the original 
sound are compared witr~"i the spectral envelope coefficients of the provisional waveform, and if the error between them 
45 is within a given range th» e provisional waveform is provided as a corrected output waveform signal to the frame com- 
bining part 250 via a switch SW1 (S3). 

[0048] In step S3, if the error between the estimated spectral envelope coefficients and the decoded spectral enve- 
lope coefficients are not within a given range, an inverse characteristic of the spectral envelope coefficients of the 
estimated provisional wsveform are given to the provisional waveform (S4). More specifically, the spectrum of the 
so provisional waveform is -plattened by applying it via a switch SW2 to, for example, an inverse filter (all-zero) 434 of, for 
example, a set of all-pol&-type linear prediction coefficients by use of the linear prediction coefficients representing the 
spectral envelope coefficients of the provisional waveform calculated in step S2. 

[0049] Next, the average power of such spectrum -flattened waveform signals is calculated in a power calculating 
part 438, and in an amou nt-of -correct! on calculating p art 439 the average power and the decoded average power from 
55 jn the auxiliary information decoding part 450 are used to calculate the amount of correction, for example, the ratio or 
difference between them, and the amount of correction is used to correct the amplitude of the flattened signal in a 
power correcting part SO 1 . That is, the output from the inverse filter 434 is multiplied by or added with the amount of 
correction to make its power equal to the decoded power (S5). Next, the amplitude-corrected flattened signal is mul- 
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tiplied by the spectral envelope coefficients of the auxiliary information to generate a provisional waveform having its 
spectral envelope coeff ic^ ients corrected (S6). That is, the output from the power correcting part 501 is applied to an 
all-pole-type synth esis f i It er 435 using the parameter LPC representing the spectral envelope of the auxiliary information 
to produce a spectrum-co rrected waveform. The spectral envelope of this waveform is close to that of the original sound. 

s [0050] However, the amplitude value of the spectrum-corrected waveform is corrected to a correct value in a cor- 
recting part 436 since th ere is a possibility that the amplitude value contains a bit contradictory to the determined bit 
in the amplitude value o~f the waveform with bit erasure (S7). For example, when lower-order four bits of a 16-bit 
amplitude value are unclear or missing, since an uncertainty width of values that each sample can take is 16, the 
amplitude value is corrected to that one of the values which is the closest to the spectrum-corrected waveform. That 

10 is, when the amplitude value falls outside the range, (XXXXXXXXXXXX0O0O—XXXXXXXXXXXX1 111), of values pos- 
sible for the corrected sample value in each sample, the amplitude value is corrected to a limit value closest to the 
sample of the spectrum- corrected waveform within the possible range. As a result, determined bits of the amplitude 
value are all coincident vwith the those of the original sound, and the spectral envelope also becomes equal to that of 
the original sound. 

15 [0051] The corrected waveform can be returned, as the provisional waveform in step S1 , via a switch SW3 to the 
provisional waveform g& nerating part 431 to repeat step S2 et seq. Incidentally, it is presumed that the waveform 
(sample value) is an integer value, but in a filter calculation it is handles as a real number; hence, it is necessary that 
the filter output value be put in an integer . In the case of a synthesis filter, the result of conversion differs depending 
on the waveform is converted for each sample or for each frame, but the both methods can be used. 

20 [0052] The broken line>s in Figs. 7 and 8 show a modification of the above procedure. That is, after the provisional 
waveform is flattened in s 1ep S4, the flattened waveform (flattened signal) is applied to the synthesis filter 435 to obtain 
a spectral-waveform -corr ected reconstructed sample sequence (waveform) (S5') : and the spectral -envelope-corrected 
waveform is amplitude- corrected in a power correcting part 501' (S6') f after which the procedure goes to step S7. In 
this instance, the average power of the spectral-envelope-corrected waveform from the synthesis filter 435 is calculated 

25 in a power calculating pa rt 438', and in an amount-of-correction calculating part 439' an amount of correction is calcu- 
lated from the calculated average power and the decoded power of the auxiliary information (from the power calculating 
part 356 in the coder 1 0) , and in a power correcting part 501 ' the obtained amount of correction is used to correct the 
amplitude of the output f rom the synthesis filter 435. 

[0053] Turning next to f=ig. 9, a description will be given of another example of the missing information compensating 

30 procedure using auxiliary^ information. 

[0054] Steps S1 to S3 and S6 are identical with steps S1 to S3 and S7 in Fig. 7. In this example, filter coefficients 
of a single synthesis filter r part 438 are calculated (S4 in Fig. 9) which is an assembly of the inverse filter 434 of an 
inverse characteristic to "the spectral envelope estimated in step S2 and the synthesis filter 435 using the linear pre- 
diction coefficients LPC representing the spectral envelope in the auxiliary information. In step S5 the provisional wave- 

35 form is applied to the syri thesis filter 438 to synthesize a corrected waveform. The corrected spectral envelope wave- 
form is amplitude correct «d (S6). This amplitude correction is made by the power calculating part 438', the amount-of- 
correction calculating part 439' and the power correcting part 501' indicated by the broken lines in Fig. 8. 
[0055] The functional c onfiguration for the Fig. 9 is indicated by the broken lines in Fig. 8. That is, the filter coefficients 
of the synthesis filter 43 S are calculated in a composite spectral envelope calculating part 437 from the estimated 

40 spectral envelope param ^ter from the spectral envelope calculating part 432 and the decoded spectral envelope co- 
efficients from the auxiliary information decoding part 450. The calculated filter coefficients are set in the synthesis 
filter part 438, to which thi e provisional waveform is p rovided. The output from the synthesis filter part 438 is amplitude 
corrected in the power correcting part 501'. 

[0056] The calculation of the filter coefficients of the synthesis filter part 438 may be conducted, for example, as 
45 described previously in connection with Fig. 10. The linear prediction coefficients as the spectral envelope coefficients 
of the provisional wavef cz>rrn are converted by the coefficient converting part 437a to the linear prediction cepstrum 
coefficients Ca, and the iiinear prediction coefficients obtained as the decoded spectral envelope coefficients of the 
auxiliary information are converted by the coefficient converting part 437b to the linear prediction cepstrum coefficients 
Cb. These coefficients O .a and Cb are applied to the subtracting part 437c to obtain the differences Cb-Ca, which is 
50 inversely converted by tl — le inverse conversion part 437d to the linear prediction coefficients, which are used as the 
filter coefficients of the synthesis filter 438. The conversion to the linear predictive coefficients can be done using, for 
example, the method described in Japanese Patent Application Laid-Open Gazette No. 248996/96 entitle "Method for 
Determining Filter Coefficients of Digital Filter." 

[0057] The procedure <=>f Fig. 9 necessitates the calculation by the synthesis spectral envelope calculating part 437 
55 but involves only one filtering calculation of the provisional waveform. The correction processing in figs. 7 and 9 may 
also be performed in the frequency domain. 

[0058] The spectrum correction based on LPC decode from the auxiliary information in steps S6 (or S5') and S5 in 
the loop of each of the f I -owcharts of Figs. 7 and 9 is indented to reduce the spectral distortion between the original 
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sound and the reconstru cted signal — this reduces the amount of correction and hence prevents divergence of the 
corrected waveform. This can be done in the examples of Figs. 7 and 9 by multiplying both of linear prediction coeffi- 
cients'©* of the inverse f i Iter 434 and linear prediction coefficients 0 k and jy of the synthesis fitters 435 and 438 by a 
k-th power (7*) of a constant y equal to or smaller than 1 (k being the order of the parameter). In the example of Fig. 
5 10 the linear prediction o ^pstrum coefficients Ca and Cb need only to be multiplied by a constant equal to or smaller 
than 1 . In the repetitive [zarocess in Figs. 7 and 9, too, it is also possible to set the constant y to a value close to a at 
the beginning of the repetition and gradually reduce the value of the constant y as convergence proceeds, thereby 
decreasing the estimatio n error. 

[0059] Incidentally, th© mu Implication of the coefficients a k , and (V by 7* and the multiplication of the linear predictive 
10 cepstrum coefficients by the constant equal to or smaller than 1 are equivalent to a multiplication by predictive coeffi- 
cients with the band of t h «e spectral envelope characteristics enlarged, making the spectral envelope of the provisional 
waveform (sample sequence) and the decoded spectral envelope of the auxiliary information dull or less sharp. 
[0060] In Figs. 7 and S, step S3 can be omitted, In which case steps S1, S2, S4, S5 (S5 1 ), S6 (S6') and S7 are 
performed only once or repeated a predetermined number of times to output the corrected waveform (sample se- 
ts quence). Further, as sho\^vn in Figs. 7 and 9, when the number of times step S3 is carried out exceeds a predetermined 
value, the corrected wav «sform obtained finally at that time may be output. 

EMBODIMENTS 

20 [0061] Fig. 11 illustrate « in block form a third embodiment of the present invention applied to the coding scheme that 
is a combination of the r— ligh-compress ion- ratio irreversible coding described previously with reference to the Fig. 1 
prior art example and th& reversible compression of the error signal between the reconstructed signal and the original 
signal. As is the case wit tn the Fig. 1 prior art example, in the coder 1 0 the digital input signal sequence from the input 
terminal 100 is irreversifc> ly quantized in the high-compression-ratio irreversible quantization part 120, then the quan- 

25 tized information is inve>r~sely quantized (that is, decoded) in the inverse quantization part 130, then the difference 
between the inversely qi— jantized signal (reconstructed signal) and the original digital input signal sequence from the 
input terminal 100 is calculated in the subtraction part 140, and the error signal that is the difference signal is applied 
to the frame forming part 110. That is, as described previously, the error signal for each frame is subjected to the 
rearrangement of its bit sequences and the separation to the transmission/recording unit data, and the transmission/ 

30 recording unit data is rev -ersibly compressed and is added with the header 31 in the header adding part 320 to form a 
packet. 

[0062] The quantized c=ode l(n) from the irreversible quantization part 120 is also fed to the header adding part 320, 
wherein it is added with the header31 to form a packet. At this time : the highest priority level is assigned to the bit 
sequence of this quanta ed code. Further, as indicated by the broken lines in Fig. 11 , for the error signal or sample 

35 sequence, a parameter representing the spectral envelope of the original input signal sample sequence and its average 
power are generated as auxiliary information in the auxiliary information generating part 350, and the auxiliary infor- 
mation is sent out as an independent packet or after being stored in a packet with high priority level. 
[0063] In this embodin — lent, the decoder 20 performs correction after synthesizing the original sound, that is, after 
reconstructing the original sound signal waveform by adding together in the adder 240 the original sound signal wave- 

40 form reconstructed by in -verse quantization and the error signal waveform. In a separation part 440 the irreversibly 
quantized code l(n), the auxiliary information and the transmission/recording unit data are separated from the packet 
input to the input terminal 200. The irreversibly quantized code l(n) is inversely quantized in an inverse quantization 
part 230. The auxiliary inf «rmation is decoded in the auxiliary information decoding part 450, and the decoded parameter 
representing the spectral envelope and the average power are provided to the missing information compensating part 

45 430. On the other hand, the pieces of transmission/recording unit data are reversibly decoded, assembled together 
and rearranged in asequ ^ntial order as described previously, by which the vertical bit sequence, that is, the error signal 
samples sequence is reconstructed, and the reconstructed error signal and the inversely quantized signal from the 
inverse quantization part: 230 are added together in the adding part 240. The added signal is applied to the missing 
information compensatin g part 430 when a packet erasure is detected in erasure detecting part 420. 

50 [0064] The missing inf c^rmation compensating part 430 may use any of the above-mentioned compensating schemes. 
In the case of using the cJ ^ecoded parameter representing the spectral envelope of the auxiliary information, the param- 
eter representing the cor responding spectral envelope, if available in the inverse quantization part 230, can be used. 
Alternatively, as indicated by the broken lines in Fig. 11, in the coder 10 the auxiliary information is generated in the 
auxiliary information gen derating part 350 from the output error signal from the frame forming part 1 1 0 or from the input 

55 signal separated frame- wvise by the frame forming part 110* and input via the input terminal 100, and the auxiliary 
information is added to a ny one of packets, or output as an independent packet. In the decoder 20 : the auxiliary infor- 
mation is separated in tl — le separation part 440, and the auxiliary information is decoded in the auxiliary information 
decoding part 450, from ^which the decoded information is fed to the missing information compensating part 430. 
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[0065] As described above, in the case of using the irreversibly quantized code and the error signal, the error signal 
* prior to the synthesis of ttne original sound may be compensated for missing information in the decoder 20. That is, for 
example, as shown in Fig. 12, in the case of a packet erasure, the rearranged output from the rearrangement part 220 
is provided to the missing information compensating part 430, wherein it is compensated for missing information: and 
5 the compensated output is applied to the frame combining part 250. For the compensation in the missing information 
compensating part 430 any one of the afore-mentioned schemes can be used. I n the case of using the spectral envelope 
of the auxiliary informatio n, the output from the auxiliary information decoding part 450 is used; alternatively, a param- 
eter representing the corresponding spectral envelope, if available in the inverse quantization part 230. may also be 
used. The reconstructed error signal from the frame combining part 250 and the inversely quantized signal from the 
10 inverse quantization part 230 are added together in the addition part 240 to reconstruct the original sound signal. 

[0066] Also in the examples of Figs. 11 and 12, the average power need not always be used as the auxiliary infor- 
mation. 

[0067] As depicted in F^ig. 11 , in case where the coder 10 separates the error signal in the frame forming part 11 O 
for each frame, the comp ression efficiency in the reversible coding part 1 50 can be enhanced by setting the separation 
is frame in the frame forming part 110, for example, approximately 16 times longer than the frame (for example, 1024 
samples) of quantization processing in the irreversible quantization part 1 20. However, the separation frame length in 
the frame forming part 1 "I 0 causes a decoding delay. 

[0068] In the embodim onts of Figs. 6 and 1 1 , the rearrangement part 1 60 need not always be provided with the sign- 
absolute value conversio n part 160. In other words, the bit sequences in a format of the 2's complement can be rear- 
20 ranged. This may decrease the coding efficiency but is effective in case where only the amplitude resolution (scalability 
of amplitude precision) is more important than the compression ratio. 

[0069] In the examples of Figs. 11 and 12, the output from the inverse quantization part 230 as well as the output 
signal from the terminal 260 may be used as the reconstructed signal in response to the request for fidelity of the 
reconstructed signal. 

25 [0070] In the above-ci ascribed examples, the coder 1 0 and the decoder 20 can also be implemented by executing 
a coding program and a decoding program on a computer. In such cases, the programs are downloaded to a program 
memory of the computer from a CD-ROM or flexible magnetic disk or via a communication line. 

[0071] To demonstrate the effect of the present invention, computer simulations on the third embodiment (coding in 
Fig. 11 and decoding in f^ig. 1 2) were performed. The number of digits of the sample value of the error signal (including 

30 a sign signal) was set to 16; sixth to tenth bits dropped out; the error signal was compensated for being smoothed by 
a low-pass filter in the m issing information compensating part 430; and psycho-acoustically corrected SNR (percep- 
tually weighted SNR) of a decoded signal (at the output terminal 260) and the cepstrum distance (distortion of the 
spectral envelope) between the decoded signal and the original sound signal were calculated. The results of the com- 
puter simulations are shown in Figs. 13A and 13B. For reference purposes, SNR and the cepstrum distance with no 

35 compensation for missin <j information are also shown. From Figs. 13A and 13B it can be seen that in case of a 6-th 
bit erasure, the compensation for missing information according to the present invention performs a significant im- 
provement in comparison to the prior art with no such erasure compensation. 

EMBODIMENT 4 

40 

[0072] Fig. 14 illustrate>s the coder 1 0 and the decoder 20 according to another embodiment of the present invention . 
This embodiment is a modification of the auxiliary information generating part 350 in the Fig. 6 embodiment. As pre- 
viously described, in the coder 10 the input signal sample sequence from the input terminal 100 is separated by the 
frame separation part 1 O O into frames each consisting of 1024 samples, for instance. In this embodiment, the number 
45 of digits representing the ■maximum one of absolute values of the input digital signals of the respective frames is detected 
as an effective digit num loer Fe in an effective digit-number detecting part 353 in the auxiliary information generating 
part 350. 

[0073] For each frame separated in the frame forming part 1 1 0 : the input signal sample sequences are rearranged 
in the rearrangement par - 1 160. In this embodiment bits of the respective samples (amplitude bit sequences) within the 

so portion corresponding to the effective digit number Fe are arranged in the temporal direction. In this case, the positive- 
or negative-integer ampli tude of each input signal sample is in a format based on a 2's complement, but it is desirable 
that each sample in a format based on a 2's complement be converted to a binary number consisting of sign bit and 
absolute value in the sig wi-absolute value conversion part 161 as referred to previously with reference to the prior art 
example and that the co ^responding bits (digits) of the respective samples (amplitude bit sequences) be rearranged 

55 in the bit sequence conversion part 1 62 to bit sequences (equi-position bit sequences) in which the corresponding bits 
are sequentially concatenated in a temporal order. As indicated by the broken lines in Fig. 14, however, the respective 
samples in a format of th» e 2's complement need not always be provided to the conversion part 161 , but instead they 
may also be provided int-act directly to the bit sequence conversion part 1 62 in which the samples of the digital signal 
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are rearranged to bitstreams over samples with the corresponding bits concatenated in a temporal order. 
[0074] That is, an ordi nary input signal sample represents the positive or negative integer in a format of the 2's 
complement, but in this example the input signal sample is converted to a binary number consisting of sign bit and 
absolute value s which is -further converted to a numerical value, and then the input signal sample is converted to an 

5 equi-position bit sequence (or a bitstreams), thereafter being separated into transmission/recording unit data in the 
transmission/recording u nit dividing part 310. An example is shown in Fig. 15A. Respective samples in the sign-abso- 
lute-value format are sequentially arranged in a temporal order for each frame as indicated by the amplitude bit se- 
quence on the left-hand side of Fig. 15A. For the sake of better understanding of one amplitude bit sequence, it is 
shown as a thick-lined amplitude bit sequence DV(n), where n represents time in one frame; for example, n=1 . 2, 

10 1 024. In this example, th& sign bit of each amplitude bit sequence DV(n) is placed right above MSB of the absolute value. 
[0075] In this instance „ that one of the digits closest to MSB in each of the amplitude bit sequences of one frame 
which is "1 n is detected, and the number of digits from LSB to the digit "1 " is obtained as the effective digit number Fe. 
The bits of the digital sig rials of one frame in the range 361 within the effective digit number Fe and the sign bits are 
converted to bit sequences. The bits at the digits in the range 362 from the digit higher-order than the effective digit 

15 number Fe to MSB are n ot converted to equi-position bit sequences. 

[0076] In the first place , as depicted on the right side of Fig. 15A, only sign bits of the amplitude values of respective 
samples in this example are concatenated in a temporal order to produce a sequence (equi-position bit sequence) in 
the frame. Next, only those digits within the effective digit number Fe which correspond to the largest numerical value 
are concatenated in the frame to produce sequences (equi-position bit sequences). Similarly, corresponding bits at 

20 each of the subsequent digits are concatenated in a temporary order to form an equi-position bit sequence, and finally 
only LSBs are concatenated into an equi-position bit sequence. An example of these equi-position bit sequences is 
indicated by the thick-lined bit sequence DH(i) on the right-hand side of Fig. 15A, where i indicates the order of gen- 
eration of each equi-posi tion bit sequence. The above rearrangement does not ever change the contents of the data 
in the frame. 

25 [0077] Incidentally, wh en the digital signal represents the positive or negative integer in a format of the 2's comple- 
ment, those digits higher-order than the digit representing the maximum one of the absolute values become all "0s M or 
all "1 s" depending on wh «ther the amplitude bit sequences are of positive or negative value as indicated by amplitude 
bit sequences of one frame in Fig. 15B and as shown in the range 364 in Fig. 15B. the number of digits in the other 
range 363 is detected as the effective digit number Fe. Only the bits in the range 364 and the bits (digits) adjacent to 

30 the range 364, only sign bits, are converted to equi-position bit sequences as indicated on the right side of Fig. 15B. 
[0078] In the transmission/recording unit separation part 310, the output from the rearrangement part 160 is sepa- 
rated to pieces of transm ission/recording unit data every equi-position bit sequence DH(i) or every plurality of adjacent 
equi-position bitsequeno es DH(i). In this instance, pieces of transmission/recording unit data each formed by one equi- 
position bit sequence an cd pieces of transmission/recording unit data each formed by plural equi-position bit sequences 

35 may be interleaved in thus same frame. 

[0079] The pieces of transmission/recording unit data thus separated are each provided to the header addition part 
320, wherein the header - 31 is added to the transmission/recording unit data (payload) 32 as shown in Fig. 4C, for 
instance. 

[0080] In this embodiment, the auxiliary information generating part 350 comprises a spectral envelope calculating 

40 part 351 , an auxiliary info rmation coding part 352, an effective digit number detecting part 353 and a power calculating 
part 354. The effective cJ igit number Fe detected by the effective digit number detecting part 353 in the input signal 
sample sequence from tine frame forming part 110 is encoded in the auxiliary information coding part 352, thereafter 
being output. Alternatively, if each sample has an m-bit configuration, it is evident that m-Fe may be sent in encoded 
form in place of the effective digit number Fe. Further, in this example, the input signal sample sequence separated in 

45 the frame forming part 1 10 for each frame is provided to the spectral envelope calculating part 351 . wherein linear 
prediction coefficients LF> C are obtained by linear predictive coding analysis, for instance, as a parameter representing 
the spectral envelope, and in the power calculating part 354 the average power Pa of the frame is calculated. Alterna- 
tively, the sample sequence of the input signal is input to an inverse filter 355 formed based on the linear prediction 
coefficients LPC calculat ed in the spectral envelope calculating part 351 , by which the spectral envelope is flattened, 

50 and the average power F=>a of such flattened signals is calculated in the power calculating part 356. 

[0081] The linear predi ction coefficients LPC and the average power Pa are also encoded with low bits, about 30 to 
50 bits, into auxiliary information in the auxiliary information coding part 340. The auxiliary information encoded from 
the effective digit numb© r Fe, the spectral envelope parameters LPC and the average power Pa are provided to the 
header addition part 320, wherein they are added in a representative packet of each frame, for instance, a packet 

55 having stored therein the transmission/recording unit data including a sign bit, or it is output as an independent packet. 
Like the Fig. 6 embodiment, the auxiliary information such as the spectral envelope parameters LPC and the average 
power Pa can be obtained for an input signal frame separated in the frame forming part 110 1 using a frame length 
longer than that in the frame forming part 1 10 as indicated by the broken line, by which the efficiency of the reversible 
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compression can be enh snced. 

[0082] In the decoder SO, the packet 30 input to the input terminal 200 is separated by the separation part 440 Into 
the transmission/recording unit data and the auxiliary information. The transmission/recording unit data is provided to 
the decoding part 210 (id entical with that 210 in Fig. 1), and the auxiliary information is provided to the auxiliary infor- 

5 mation decoding part 45 O. The auxiliary information decoding part 450 decodes the effective digit number Fe, the 
spectral envelope param eters LPC and the average power Pa of the frame concerned, and provides the effective digit 
number Fe to a digit adjusting part 460 and the spectral envelope parameters LPC and the average power Pa to the 
missing information compensating part 430. The mission information compensating part 430 : the auxiliary information 
decoding part 450 and tri e digit adjusting part 480 constitute an information compensating part 480. 

10 [0083] When the transmission/recording unit data is reversibly compressed, it is reversibly decoded in the decoding 
part 210, and respective pieces of transmission/recording unit data are provided to a transmission/recording unit as- 
sembling part 410, where in based on the packet numbers, they are assembled into oneframe formed by plural packets, 
for example, such an eq lj i-position bit sequence as shown on the right side of Fig. 15A. The assembled data is fed to 
the rearrangement part S20, wherein the equi-position bit sequences are converted to amplitude bit sequences, that 

15 is, to the signal sample s ^quences (waveform). In this case, when each sample is represented by an amplitude value 
in a sign-absolute binary format, the equi-position bit sequences are converted by the bit sequence conversion part 
221 into amplitude bit secquences as depicted on the right side of Fig. 15B unlike the rearrangement described above 
with reference to Fig. 1 5/=V and then in the 2's complement conversion part 222 each amplitude bit sequence from the 
bit sequence conversion part 221 is converted to the 2's complement format, that is, the amplitude bit sequence of the 

2Q negative sign bit has its 1 " and "0" exchanged. 

[0084] Incidentally, when the transmission/recording unit data is based the equi-position bit sequence directly rear- 
ranged from the amplitude bit sequence in a format of the 2's complement, the amplitude bit sequence from the bit 
sequence conversion pa rt 221 is provided intact to the digit adjusting part 400. The digit adjusting part 460 performs 
digit adjusting for each Samplitude bit sequence according to the decoded effective digit number Fe. That is, in order 

25 that the number of the bits (the number of digits) of the amplitude bit sequence may become equal to that of the original 
signal samples, "0" or "1 " is added to the high-order digit of the amplitude bit sequence, depending on whether the 
sign bit is positive or negative, that is : a bit in the range 363 in Fig. 15B : for instance, is added. The digit-adjusted 
amplitude bit sequence is provided as a decoded sample to the frame combining part 250. 

[0085] When a packet erasure occurs , the packet number of the missing packet is detected by the erasure detecting 
30 part 420, and the amplitu cle bit sequence from the rearrangement part 220 is not directly provided to the digit adjusting 
part 460, but instead it is fed to the missing information compensating part 430, wherein the amplitude bit sequence 
(sample) is compensated for the missing information, and the amplitude bit sequence is supplied to the digit adjusting 
part 460. 

[0086] The compensat ion in the missing information compensating part 430 is performed by estimating the missing 
35 information from known information. The missing information compensating part 430 compensates for the missing 
information so that the spectrum available from other information than the missing information of the frame concerned 
approaches an average spectrum of several preceding frames as in the embodiments described previously or a de- 
termined spectrum in a frame obtained as the result of decoding of the auxiliary information as referred to later on. A 
simple compensating m&thod is to remove a noise component in the high-frequency region by the input reconstructed 
40 sample sequence to a low-pass filter in the missing information compensating part 430. The cut-off characteristic of 
the low-pass filter is chosen such that it attenuates the high-frequency component according to its characteristic if the 
spectral envelope of the original signal is known. Alternatively, the cut-off characteristic may adaptively be changed 
according to the averags power or the shape of a spectrum determined for each frame. 

[0087] Even if the bit rate is decreased by intentionally refraining from sending LSB side packets to the decoder 20, 
45 as required, with a view to reduction of the amount of information through utilization of the fact that the decoder 20 is 
capable of compensating for the information lost because of a packet erasure as described above, the decoder 20 is 
capable of implementing decoding or signal reconstruction free from the psycho-acoustical problem. 
[0088] It is also possib I e to use as an alternative to the above the method described below. All possible combinations 
of the missing information (bit) are added to each sample value to produce candidates for a compensated sample 
so sequence (waveform), thi en the spectral envelopes of the candidates are calculated, and that one of the candidate for 
the compensated sample sequence (waveform) whose spectral envelope is the closest to the decoded spectral enve- 
lope of the auxiliary information is output as a compensated sample sequence to the digit adjusting part 460. Incidentally, 
the reversible coding part 150 and the decoding part 210 in Fig. 14 may be omitted. 

55 Compensation based on auxiliary information 

[0089] In the case of producing the candidates for the compensated sample sequence by use of all possible com- 
binations for the missing information, an increase in the amount of missing information (bit) causes a considerable 
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increase in the number o i candidates, giving rise to a problem such as an impractical computational complexity. An 
* embodiment to implemen m the processing by means of the missing information compensating part 430 and its functional 
configuration is describee — I below. 

[0090] Fig. 16 depicts ^^n example of the procedure to be followed and Fig. 17 an example of the functional config- 
5 uration of the missing infers rmation compensating part 430. Steps S1 to S6 are the same as steps S1 to S4, S6 and S7 
in Fig. 7. In the first places, only determined bits input to the provisional waveform generating part 431 from the rear- 
rangement part 220 are u sed to reconstruct a provisional waveform (a provisional sample sequence) in the frame (S1 ) . 
The provisional wavefom — us reconstructed with the missing bit fixedly set to, for example, 0 or an intermediate value 
for a possible missing bit. ^or example, if low-order four bits are missing, their values are any one of 0 to 1 5; provisionally, 
10 it is set to 8 or 7. 

[0091] Next, the spectral envelope of the provisional waveform is calculated in the spectral envelope calculating part 
432 <S2). The spectral ei — ivelope coefficients can be analyzed by subjecting the provisional waveform to an all-pole- 
type linear predictive cod i myg analysis that is used in speech analysis, for instance. On the other hand, received auxiliary 
information Ax is decode <=d in the auxiliary information decoding part 450 to provide the spectral envelope coefficients 
is of the original sound, anal in an error calculating part 433 the spectral envelope coefficients of the original sound are 
compared with the spectral envelope coefficients of the provisional waveform, and if the error between them is smaller 
than a predetermined value Ad. the provisional waveform is provided as a corrected output waveform signal to the 
frame combining part 250 (S3). 

[0092] In step S3, if th&- error between the estimated spectral envelope coefficients and the decoded spectral enve- 

20 lope coefficients is not si — nailer than the predetermined value Ad, an inverse characteristic of the spectral envelope 
coefficients of the estimated provisional waveform is given to the provisional waveform (S4). More specifically, coeffi- 
cients representing the sj^Dectra! envelope of the provisional waveform obtained in step S2 are set in, for example, an 
all-pole-type (all-zero-typ «e) linear prediction inverse filter 434, and the provisional waveform is applied to the inverse 
filter 434 to flatten the sp ^ctrum of the provisional waveform to obtain a flattened signal. The average power of such 

25 a flattened signal is calci ilated in the power calculating part 438. In an amount-of -correction calculating part 439 an 

amount of correction is calculated from the average power and the decoded average power (the output from the power 
calculating part 438) fron — i the auxiliary information decoding part 450 to detect the ratio or difference between them. 
Based on the calculated ^=imount of correction, the power correcting part 501 corrects the amplitude of the output from 
the inverse filter 434 that is, multiples or adds the output from the inverse filter 434 by or with the amount of correction 

30 so that the power of the provisional waveform equals to the decoded power (S5). 

[0093] Next, the characteristics of the spectral envelope of the auxiliary information is imparted to the amplitude- 
corrected flattened signal to correct its spectral envelope (S6). The outputfromthe power correcting part 501 is applied 
to an all-pole-type synthessis filter 435 using the parameters LPC representing the spectral envelope of the auxiliary 
information to produce a spectrum -corrected waveform. The spectral envelope of this waveform is close to that of the 

35 original sound. 

[0094] However, since t: here is a possibility that the spectrum-correct waveform is contradictory to already determined 
bits in the amplitude bit s ^quence, it is corrected to a correct value in the correcting part 436 (S7). 
[0095] Step S2 and the ^subsequent steps can be repeated using the corrected waveform as the provisional waveform 
in step S1 . When the decs oded effect digit number Fe differs with frames, the samples can be processed by the linear 

40 prediction coding analysis in the spectral envelope calculating part 432 (step S2) : by the inverse filter 434 (step S4) 
and by the synthesis filt^sr 435 (step S6) span the current and preceding frames. In this instance, even during the 
current frame processing^ , it is necessary that the effective digit number Fe of the immediately preceding frame be 
made equal to the effective digit number Fe of the current frame prior to the analysis or filtering. When the effective 
digit number Fe of the im ■mediately preceding frame is smaller than the effective digit number Fe of the current frame 

45 by N digits, the sample <zz>f the immediately preceding frame is shifted N digits to the low-order side to reduce the 
amplitude value, with the effective digit number equal to that of the current frame. Conversely, when the effective digit 
number of the immediate sly preceding frame is larger than the effective digit number of the current frame by M digits, 
the sample of the immedi ^tely preceding frame is temporarily upward shifted by M digits. For example, in the floating- 
point representation to in<=:rease the amplitude value, with the effective digit number equal to that of the current frame. 

so When the amount of info rmation lost by a register overflow due to the high-order shift is large, the accuracy of the 
amplitude value of the sa t — nple of the immediately preceding frame is impaired, so that the sample with the degradation 
is not used or the sample of the current frame need not always be corrected. 

[0096] As indicated by mhe broken lines in Fig. 16, when such a correction of the effective digit number is necessary 
for the analysis in step S^=, the above-described correction of the effective digit number is made (S2') prior to step S2. 
55 When it is necessary for mhe inverse filtering in step S4 ; the effective digit number is corrected (S4') prior to step S4. 
In case of the synthesis filtering in step S6, the effective digit number is corrected (S6') prior to step S6. In Fig. 17, 
when the spectral envelo m^ e calculating part 432, the inverse filter 434 and the synthesis filter 435 require the sample 
of the preceding frame, tl — le reconstructed effective digit number Fe is also provided to any of them from the auxiliary 
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information decoding part 450 as indicated by the broken lines so that they perform their processing after making the 
effective digit number of the sample of the preceding frame equal to the effective digit number of the current frame. 
[0097] The broken lines in Figs. 16 and 17 show a modification of the above procedure. After the provisional waveform 
is flattened in step S4, the flattened waveform (flattened signal) is applied to the synthesis filter 435 to obtain a spectral- 

s envelope-corrected reconstructed sample sequence (waveform) (S5'), and the spectral-envelope-corrected waveform 
is amplitude-corrected in the power correcting part 501 ' (S6 l ), after which the procedure goes to step S7. In this instance, 
the average power of the spectral-envelope-corrected waveform from the synthesis fitter 435 is calculated in the power 
calculating part 438', and in the amount-of-correction calculating part 439' an amount of correction is calculated from 
the calculated average p pwer and the decoded power of the auxiliary information (from the auxiliary information de- 

10 coding part 450), and in tr-ie power correcting part 501 ' the amount of correction obtained is used to correct the amplitude 
of the output from the sy nthesis filter 435. When the processing by the synthesis filter 435 in step S5' spans the im- 
mediately preceding and the current frame, the effective digit number is corrected in advance as indicated by step S5". 
[0098] Turning next to F=ig. 1 8, a description will be given of another example of the missing information compensating 
procedure using compen -sating information. This missing information compensating processing is based on the same 

*5 principles as those using the composite spectral envelope calculating part 437 and the synthesis filter part 435' in Fig. 8. 
[0099] Steps S1 to S3 and S6 are identical with those S1 to S3 and S7in Fig. 16. In this example, the filter coefficients 
of the synthesis filter part 438, which is an assembly of the inverse filters 434 using the spectral envelope parameter 
estimated in step S2 anc* the synthesis filter 435 using the spectral envelope parameter of the auxiliary information, 
are calculated in stepS 4 i n Fig. 16. In step S5 the provisional waveform is applied to the synthesis filter 438 to synthesize 

20 a waveform of a correcte d spectral envelope. The waveform of the corrected spectral envelope is amplitude corrected 
in the broken-lined p owe- r correcting part 501" (S6). This amplitude correction is made by the power calculating part 
438', the amount-of-correction calculating part 439' and the power correcting part 501*. The filter coefficients of the 
synthesis filter 501 1 are o alculated, for example, by the scheme described previously with reference to Fig. 10. 
[0100] The procedure shown in Fig. 18 necessitates the calculation of the filter coefficients of the synthesis filter part 

25 435' by the composite sp ectral envelope calculating part 437 but involves only one filter operation for the provisional 
waveform. The correction processing depicted in Figs. 16 and 18 may also be carried out in the frequency domain. 
[0101] When a previous sample is needed for the spectral envelope calculation in step S2 orforthe spectral envelope 
correction in step S5 in F=ig. 18, the afore-mentioned effective digit number correction is made prior to step S2 or S5 
as indicated by the broken lines (S2' orS5'). 

30 [0102] In the loop in e> ach of the flowcharts of Figs. 16 and 18, the spectral envelope correction based on LPC 
decoded from the auxilia. ry information in step S6 (or S5') and S5 is intended to reduce spectrum distortion and the 
correction in step S7 is to reduce waveform distortion of the reconstructed signal relative to the original sound. The 
repetition of this operatio n by the loop does not guarantee convergence of the waveform, but as described previously 
with respect to Figs. 7B snd 9, it prevents divergence of the reconstructed waveform through multiplication of linear 

35 prediction coefficients ot k of the inverse filter 434 and linear prediction coefficients p k and j} k ' of the synthesis filters 435 
and 438 by the constant -y*, where y is 0<y<1 and k is the order of the parameter. 

[0103] In the example cz>f Fig. 1 0 all of the linear prediction cepstrum coefficients Ca and Cb need only to be multiplied 
by a constant equal to or smaller than 1 . In the repeating process in Figs. 16 and 18, too. it is also possible to set the 
constant yto a value close to 1 at the beginning of the repetition and gradually reduce the value of the constant y as 

40 convergence proceeds, t hereby decreasing the estimation error 

[0104] In Figs. 16 and 18, step S3 may be omitted, in which case steps S1, S2, S4, S5 (S5'), S6 (S6') and S7 are 
performed only once or repeated a predetermined number of times to output the corrected waveform (sample se- 
quence). Further, as shown, when the number of times step S3 is carried out exceeds a predetermined value, the 
corrected waveform obta. ined finally at that time may be output from the missing information compensating part 430. 

45 [0105] The digit adjust! ng part 460 may be placed immediately behind the rearrangement part 220 as indicated by 
the broken line in Fig. 1 In this case, the afore-mentioned adjustment of the effective digit number in the missing 
information compensatin s pat 430 is unnecessary. Moreover in the missing information compensation shown in Figs. 
16 and 18, the amplitude correction in steps S5, S6' and S6 may be omitted. In this instance, the associated parts 438*, 
439' and 501 ' are left out _ In some cases, the missing information compensation using the decoded spectral envelope 

so may be omitted and replaced with a different compensating scheme such as the afore-mentioned one that uses a low- 
pass filter, or makes correction to put the spectral envelope coefficients of the current frame into agreement with that 
of the preceding frame. I n such case, the generation of the auxiliary information about the spectral envelope or the 
average power is omittec^, and the configuration of the missing information compensating part 430 in the decoder 20 
will be different from the Fig. 1 7 configuration. 

55 

EMBODIMENT 5 

[0106] Fig. 19 illustrate s in block form a fifth embodiment of the present invention in which the coding method, which 
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rearranges the effective digits of the sample in each frame as described previously with reference to Fig. 14, is applied 
to the coding method that is a combination of the high-compression-ratio coding scheme described previously in respect 
of Fig. 1 and the scheme of reversible compression of the error signal between the reconstructed signal and the original 
signal. The coder 1 0 of th is embodiment is identical in configuration with the coder 1 0 of the Fig. 1 1 embodiment except 

5 that the bit sequence conversion part 162 performs the rearrangement of the effective digits described in connection 
with Fig. 15Aor 15B and that the auxiliary information generating part 350 is identical in construction with the auxiliary 
information generating pari 350 in the Fig. 14 embodiment. The decoder 20 is also identical in configuration with the 
decoder 20 in the Fig. 1 "1 embodiment except that the digit adjusting part 460 is provided at the output side of the 
rearrangement part 220 and the missing information compensating part 430 is that in the Fig. 14 embodiment and 

10 consequently in the Fig. 17 embodiment. Accordingly, no detailed description will be repeated. 

[0107] As described atoove, in case of using the irreversibly quantized code and the error signal, the error signal 
prior to the synthesis of tine original sound may be compensated for missing information in the decoder 20. That is, for 
example, as shown in Fig. 20, in the case of a packet erasure, the rearranged output from the rearrangement part 220 
is provided to the missing information compensating part 430, wherein it is compensated for missing information, and 

*s the compensated output is applied to the digit adjusting part 460. When missing information is absent, the output from 
the rearrangement part 2 :20 is provided directly to the digit adjusting part 460, and the digit-adjusted sample sequence 
is supplied to the frame combining part 250. For the compensation in the missing information compensating part 430 
any one of the afore-m& ntioned schemes can be used. In the case of using the decoded spectral envelope of the 
auxiliary information or/a nd the decoded average power, the decoded output from the auxiliary information decoding 

20 part 450 is used; alternat i vely, the parameter LPC representing the corresponding spectral envelope, if available in the 
inverse quantization part 230. may also be used. The reconstructed error signal from the frame combining part 250 
and the inversely quantized signal from the inverse quantization part 230 are added together in the addition part 240. 
As indicated by the broken lines in Fig. 20, the digit adjusting part 460 may be placed immediately after the rearrange- 
ment part 220. 

25 [0108] The coder 1 0 sends out at least the effective digit number and the transmission/recording unit data for each 
frame and that the decocier 20 uses them to perform decoding. 

EMBODIMENT 6 

30 [0109] Fig. 21 illustrates in block form a coder 1 0 and a decoder 20 according to a sixth embodiment of the present 
invention. This embodiment sends out a prediction error of the input signal sample sequence after converting it to the 
equi-position bit sequeno e instead of converting the frame-separated input signal sample sequence to the equi-position 
bit sequence in the Fig. S embodiment. 

[0110] The coder 10 d i~ffers from that 10 in Fig. 6 in the additional provision of a prediction error generating part 370 
35 comprised of a sample register 371 , an integer part 373 and a difference circuit 374. The decoder 20 also differs from 
that 20 in Fig. 6 in the add itional provision of a synthesis filter 470 comprised of a sample register 471 , a linear prediction 
part 472, an integer part 473 and an addition part 474. The input signal sample sequence is provided for each frame 
from the frame forming psart 110 to the spectral envelope calculating part 351 of the auxiliary information generating 
part 350 and the differen ce circuit 374 of the prediction error generating part 370. The input signal sample sequence 
40 is subjected for each frame to, for example, linear predictive coding in the spectral envelope calculating part 351 , from 
which is provided linear §Drediction coefficient LPCs as parameters representing the spectral envelope. The spectral 
envelope parameters LP C are encoded in the auxiliary information coding part 352. 

[0111] For example, a predetermined number of samples of the immediately preceding frame from the frame forming 
part 110 is supplied from the register 371 to the linear prediction part 372, wherein these sample sequences are mul- 
45 tiplied by or added with li near prediction coefficients based on the spectral envelope parameters LPC from the spectral 
envelope calculating part 351, by which is calculated linear prediction for each input sample. The linear prediction value 
is converted in the integer part 373 to an integer value. The difference between the prediction value in an integer form 
and the current sample f= rom the frame forming part 110 is calculated as a prediction error signal sample Spe in the 
difference circuit 374. 

so [0112] The obtained p rediction error signal Spe for each input sample is applied to the rearrangement part 160, 
wherein corresponding fc> Its (digits) of the prediction error signal samples Spe (amplitude bit sequences) for the respec- 
tive input samples are arranged in a temporal order for each frame as described previously with reference to Fig. 4A. 
The equi-position bit sequences from the rearrangement part 160 are separated by the transmission/recording unit 
separation part 310 to transmission unit or recording unit data. These separated pieces of transmission/recording unit 

55 data are subjected to rev ersible compression coding, if necessary, in the reversible coding part 1 50, and in the header 
adding part 320 the separated pieces of transmission/recording unit data are added with the header so that they can 
be reconstructed as one frame when decoded, thereafter being provided as a packet to the output terminal 1 70. 
[0113] The coding information (auxiliary information) for the spectral envelope parameters LPC from the auxiliary 
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information coding part 3 50 is output as one packet from the header adding part 320 or output therefrom after being 
loaded in the packet of tr-ie highest priority level. 

[0114] In the decoder SO, the packets from the input terminal 200 are each separated to the auxiliary information 
and the transmission/rec=ording unit data (containing a sign bit sequence) in the separation part 440, the auxiliary 

5 information is provided to the auxiliary information decoding part 450. When reversibly compressed, the transmission/ 
recording unit data is fed to the decoding part 21 0, wherein it is reversibly decoded, and each piece of transmission/ 
recording unit data is provided to the transmission/recording unit assembling part 410, wherein based on the packet 
numbers, pieces of transmission/recording unit data of one frame are assembled from plural packets. The assembled 
data is provided to the rearrangement part 220, wherein bit sequences are converted signal samplesof one frame, 

10 providing a prediction err~or waveform. 

[0115] Incidentally, when the transmission/recording unit data is based on the equi-position bit sequence directly 
rearranged from the amplitude bit sequence in a format of the 2*s complement: the amplitude bit sequence from the 
bit sequence conversion part 221 is provided intact as a decoded sample to the synthesis filter 470, bypassing the 
missing information comfoensating part 430 as indicated by the broken lines in Fig. 21 . When no packet are erased 

15 occurs, exactly the same prediction error signal Spe as the prediction error signal samples Spe input to the rearrange- 
ment part 1 60 of the code r 1 0 is provided from the rearrangement part 220. The synthesis filter 470 performs processing 
inverse to the synthesis f i Iter prediction error generating part 370 of the coder 1 0. That is, a predetermined number of 
immediately preceding samples are input from the register 471 to the linear prediction part 472, wherein the samples 
are each multiplied by th e linear prediction coefficients LPC decoded in the auxiliary information decoding part 450, 

20 and the sum of the results of multiplication is provided as a prediction value of the current sample. This prediction value 
is rendered by the integer part 463 to an integer value, and the sum of this integer value and the current prediction 
error signal from the rear rangement part 220 is calculated in the addition part 474, and the sum if provided as the filter 
output from the synthesis filter 470 to the frame combining part 259 and the register 471 as well. Accordingly, digital 
signals are synthesized i n the synthesis filter 470 and concatenated in the frame combining part 250, and the signal 

25 input to the input temnina.1 100 of the coder 10 is reconstructed and provided to the output terminal 260. 

[0116] When a packet is erased occurs, the packet number of the input packet concerned is detected in the erasure 
detecting part 420, and the amplitude bit sequence from the rearrangement part 220 is not provided directly to the 
synthesis filter 470. Instead they are supplied to the missing information compensating part 430, wherein the amplitude 
bit sequence (the predict: ion error signal) is compensated for the missing information, and the compensated output is 

30 applied to the synthesis filter 470. 

Compensation for missin g information 

[0117] A description wi II be given, with reference to Figs. 22 and 23, of the procedure and configuration of the missing 

35 information compensatin g part 430 for obtaining the prediction error waveform compensated for missing information. 
[0118] A prediction em or waveform (the one-frame sample sequence output from the rearrangement part 220) is 
input to a provisional waveform generating part 431 . which generates a provisional prediction error waveform in the 
frame using only determi ned bits (S1). At this time, missing bits are fixed to, for example, to zeros or an intermediate 
value in the range of all potential values. 

40 [01 19] Next, the spectr~al envelope of the provisional prediction error waveform is calculated in a spectral envelope 
calculating part 432 (S2) - The spectral envelope can be estimated by subjecting the provisional prediction error wave- 
form to, for example, all-|30le-type linear predictive coding analysis that is used in speech analysis. Since the spectral 
envelope of the predictio wi error waveform generated in the prediction error waveform generating part 370 of the coder 
10 becomes substantiality flat, it is expected that the estimated spectral envelope is flat if the provisional prediction 

45 error waveform is identical with the waveform of the original prediction error signal obtained in the prediction error 
generating part 370 of th « coder 1 0. However the spectral envelope does not become flat if the provisional prediction 
error waveform differs from the waveform of the original prediction error signal. It is checked in a flatness decision part 
433F if the flatness is witrnin a given limit (S3). If the flatness is within the limit, the provisional prediction error waveform 
is output intact to the syr— ithesis filter 470. 

so [0120] The decision of the flatness uses, as the criterion therefore, a value obtained by dividing the arithmetic means 

of linear prediction coeffi clients c 1t c 2 c M obtained as parameters of the spectral envelope in the spectral envelope 

calculating part 432 by ttne geometric mean of the coefficients. E.g., if the above-mentioned value is 0 dB, then it is 
decided that the spectral envelope is completely flat, and if the value is 3 dB or less, for instance, it is decided that the 
spectral envelope is substantially flat. Alternatively, LPC cepstrum coefficients are used as the spectral envelope pa- 

55 rameters. For example if the sum of their squares is smaller than a certain value, it is decided that the spectral envelope 
is substantially flat. 

[0121] When it is decicded that the spectral envelope configuration greatly differs from the flat configuration, a first 
step is to introduce an i mverse characteristics of an estimated spectral envelope to the provisional prediction error 
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waveform (S4). Concrete- ly, the provisional prediction error waveform is applied to, for example, an all-pole-type linear 
prediction inverse filter (a. Il-zero) 434 to flatten the spectrum of the provisional prediction error waveform. The spectral 
envelope need not be completely flattened but with the bandwidth of the spectral envelope characteristic enlarged, 
consequently the steep n ess of the spectral envelope can be reduced. 

5 [0122] Since there is a possibility that the flattened waveform is contradictory to determined amplitude bits obtained 
from normally received packets, it is corrected to a correct value in a correcting part 436 (S5). For example, when 
lower-order four bits of a n amplitude value of 16-bit accuracy are missing, values possible for each amplitude bit se- 
quence (prediction error s ignal) originally represents one of 16 uncertain values, but if the corrected spectrum waveform 
contains an amplitude bit sequence outside the range of the 1 6 values the waveform is corrected to a value closest to 

10 the amplitude within the range, in this example, 1 5 that is an amplitude bit sequence represented by the value of lowest- 
order four bits. As a result, the determined bits of the amplitude value are all equal and the spectral envelope is recon- 
structed in a waveform c lose to that of the original prediction error signal. If necessary, the procedure returns to step 
S1 , repeating the correct ion processing using the corrected waveform as the provisional prediction error. 
[0123] Incidentally, it is presumed that the corrected prediction error (provisional prediction error) waveform is an 

15 integer value, but in a filter calculation it is handled as a real number; hence, it is necessary that the filter output value 
be put in an integer form . In the case of a synthesis filter, the result of conversion differs depending on the waveform 
is converted for each am plitude or for each frame., but the both methods can be used. 

[0124] In the case of p roducing the candidates for the compensated sample sequence by use of all possible com- 
binations of values for th, e missing bits, an increase in the number of missing bits causes a considerable increase in 
20 number of candidates f o tr the compensated amplitude bit sequence (waveform), giving rise to a problem i.e., an im- 
practical computational complexity. A description will be given below of the processing by the missing information 
compensating part 430 and its functional configuration that will solve such a problem. 

[0125] Fig. 24 depicts &n example of the procedure to be followed and Fig. 17 an example of the functional config- 
uration of the missing information compensating part 430. In the first place, only determined bits input to the provisional 
25 waveform generating part 431 from the rearrangement part 220 are used to reconstruct a provisional prediction error 
waveform (a provisional amplitude bit sequence) in the frame (S1). The provisional prediction error waveform is re- 
constructed with the miss ing bits fixed to, for example, 0 or an intermediate value within a range of the possible values 
for the missing bits. For example, if lowest-order four bits are missing, any one of levels from 0 to 15 can be correct, 
provisionally, set to 8 or "7. 

30 [0126] Next, the linear prediction coefficients LPC of the spectral envelope produced by decoding the received aux- 
iliary information are set in the synthesis filter 436, and the provisional prediction error waveform is applied to the 
synthesis filter 435 to synthesize the original input signal waveform to the coder 10 by linear prediction (S2). The 
spectral envelope of the synthesized waveform is calculated in a spectral envelope calculating part 432 (S3). In an 
error calculating part 433 the calculated spectral envelope and the spectral envelope of the original sound (the original 

35 input signal) received as auxiliary information, are compared by calculating the spectral envelope decoded in the aux- 
iliary information decodin eg part 450. If the error between the two spectral envelopes is within a given limit, the provisional 
prediction error waveform is output as a compensated prediction error waveform (compensated amplitude bit sequence) 
to the synthesis filter 470. (S4). 

[0127] If the spectral e rive I ope of the provisional prediction error waveform and the spectral envelope generated by 
40 decoding the auxiliary inf" ormation greatly differ from each other in step S4, that is, if the provisional prediction error is 
incomplete, an inverse o naracteristics of the calculated spectral envelope is introduced to the provisional prediction 
error waveform (S5). Concretely, the provisional prediction error waveform is applied to, for example, an all-pole-type 
linear prediction inverse -filter (all-zero) 434 to flatten the spectrum of the provisional prediction error waveform. The 
spectral envelope need n ot be completely flattened but with a bandwidth of the spectral envelope characteristic broad - 
45 ened, consequently the steepness of the spectral envelope can be reduced. 

[0128] Next, the characteristic of the reconstructed spectral envelope is imparted to the flattened signal (S6). The 
output from the inverse f ilter is applied to an all-pole-type synthesis filter 435 having set therein the parameters LPC 
representing the spectra I envelope generated by decoding auxiliary information to produce a prediction error waveform 
based on the provisional prediction error waveform. The resulting prediction error waveform can approximate the orig- 
50 inal prediction error waveform (signal). 

[0129] As is the case with Fig. 22, since there is a possibility that the corrected prediction error waveform contains 
a bit contradictory to a kn own amplitude bit., the prediction error waveform is corrected to a correct value in the correcting 
part 436 (S7). 

[0130] Step S2 and th<= subsequent steps are repeated using the corrected prediction error waveform as the provi- 
55 sional prediction error waveform in step S1 . As indicated by the broken lines in Figs. 24 and 25, step S4 may also be 
followed by step S5' in xyvhich to synthesize the provisional prediction error waveform by use of the reconstructed 
spectral envelope pararn eter (by applying the provisional waveform to a synthesis filter 435') then by step S6' in which 
to introduce the inverse characteristic of the calculated spectral envelope to the synthesized waveform (by applying 
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the waveform to an inverse filter 434'). In case of omitting coefficients with the broadened bandwidth, the waveform 
synthesized for obtaining the prediction coefficients, that is, the output waveform from the synthesis filter 502 may be 
supplied to the inverse filter 434. 

[0131] Turning next to F^g. 26, a description will be given of another example of the missing information compensating 
5 procedure using the reco nstructed spectral envelope. 

[0132] Steps S1 to S4 and S7 are identical with those S1 to S4 and S7 in Fig. 24. In this example : after step S6, the 
filter coefficients of the sy nthesis filter part 438, which is an assembly of the inverse filter 434 using the spectral envelope 
coefficients estimated in step S2 and the synthesis filter 435 using the reconstracted spectral envelope parameters, 
are calculated (S5). In st ep S6 the provisional prediction error waveform is applied to the synthesis filter 438-to syn- - 
10 thesize a corrected predi ction error waveform. 

[0133] The functional csonfigu ration for implementing the process shown in Fig. 26 is indicated by the broken lines 
in Fig. 25. The filter characteristics of the synthesis filter part 438, which is a combination of the inverse filter 434 and 
the synthesis filter 438, is calculated in the synthesis spectral envelope calculating part 437 from the decoded spectral 
envelope parameters LPCs from the auxiliary information decoding part 450 and estimated spectral envelope param- 
os eters a from the spectral envelope calculating part 432. Then the provisional prediction error waveform is applied to 
the synthesis filter part 4-C38. 

[0134] The calculation of the fitter coeffidents of the synthesis filter part 438 is conducted as described previously 
with reference to Fig. 1 0 . That is, the linear prediction coefficients of the provisional error waveform are converted in 
the coefficient conversion part 437a to linear prediction cepstrum coefficients Ca : and the linear prediction coefficients 
20 of the reconstructed spectral envelope are converted in the coefficient conversion part 437b to the linear prediction 
cepstrum coefficients Ct>. These coefficients Ca and Cb are provided to the subtraction part 437c to calculate the 
difference Cb-Ca, which i s inversely converted in the inverse conversion part 437d to the linear prediction coefficients, 
which are used as the filter coefficients of the synthesis filter part 438. 

[0135] To prevent dive r-gence of the prediction error waveform by the repetitive processing in the flowchart of Fig. 

25 22, the linear prediction coefficients a k of the inverse filter 434 in the examples of Figs. 22, 24 and 26 and the linear 
prediction coefficients p k and p k ' of the synthesis filters 435 and 438 in the examples of Figs. 24 and 26 are multiplied 
by the k-th power of the constant y equal to or smaller than 1 (k being the order of the parameter). In the example of 
Fig. 1 0 the linear predict! "ve cepstrum coefficients need only to be multiplied by a constant equal to or smaller than 1 . 
In the repetitive process in Figs. 22, 24 and 26, too, it is also possible to set the constant y to a value close to a at the 

30 beginning of the repetition and gradually reduce the value of the constant y as convergence proceeds : thereby de- 
creasing the estimation error. 

[0136] Steps S3 in Fig - 22 and S4 in Figs. 24 and 26 may be omitted, and steps S1 , S2, S4 and S5 in Fig. 22 and 
S1 , S2 : S5, S6 and S7 in Figs. 24 and 26 may be performed only once or repeatedly a predetermined number of times 
to output the corrected p rediction error waveform (amplitude bit sequences). When the repetition counts of steps S3 
35 jn Fig. 22 and S4 in Figs, 24 and 26 exceed a prescribed value, the corrected prediction error waveform finally available 
may be output. The proc ossing in Figs. 22, 24 and 26 may also be carried out in the frequency domain. In this case, 
for example, inverse filte ring becomes a normalization process. 

[0137] The amplitude o f the prediction error signal Spe frequently becomes smaller. When the prediction error signal 
Spe is represented by a binary number consisting of a sign and absolute value, high-order digits of each prediction 

40 error signal Spe (amplitu de bit sequence) become "0s" throughout the frame in many case as referred to previously 
with respect to Figs. 15 A. and 15B. Accordingly, the number of digits representing the maximum value of the absolute 
value in one frame is calculated as the effective digit number, that is the maximum number of digits including "1" is 
detected as the effective digit number Fe in an effective digit number detecting part 163 of the coder in Fig. 21 . The 
effective digit number Fe- is also encoded in the auxiliary information coding part 352, from which it is output together 

45 with the spectral envelop e parameters LPC, and only bits in an range 41 of the effective digit number Fe and the sign 
bit are converted to an e*qui -position bit sequence in the rearrangement part 1 60, from which it is output to the trans- 
mission/recording unit separation part 31 0. 

[0138] In the decoder 20 ; the reconstructed prediction error waveform formed by the amplitude bit sequences from 
the rearrangement part ^20 or the corrected amplitude bit sequences is digit-adjusted in the digit adjusting part 460 

50 using the effective digit number Fe reconstructed in the auxiliary information decoding part 430. For example, when 
the reconstructed prediction error waveform (amplitude bit sequences) input to the digit adjusting part 460 is like the 
amplitude bit sequences of the digit number Fe on the right side of Fig. 15B, those of the amplitude bit sequences (in 
a format of the 2's complement) whose sign bits are positive ("0") as shown on the left side of Fig. 15B are each added 
at high-order places with* "0s" equal in number to the difference m-Fe between the bit width m of each amplitude bit 

55 sequence (the bit width of the prediction error signal Spe input to the rearrangement part 1 60 in the coder 1 0) and the 
effective digit number And the amplitude bit sequences of negative sign bits ( n 1 w ) are added at high-order place 
with "1s" of the same number as m-Fe. 

[0139] The reconstructed prediction error waveform thus digit adjusted is provided to the synthesis filter 470. The 
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addition of the effective ci igit number to the auxiliary information enhance the coding efficiency. Incidentally, the pre- 
diction error signal (ampl itude bit sequences) need not always be converted to that in the binary format consisting of 
the sign bit and the absol ute value in the rearrangement part 160 of the coder 10, instead the effective digit number 
Fe can be output as auxi I iary information for the amplitude bit sequences in a format of the 2's complement, too. Also 
5 in this instance, the numt> er of digits lowest-order than those highest-order digits which are "0" or "1° in common to all 
the amplitude bit sequences, as depicted on the left side of Fig. 15B are the effective digit number Fe, and the least 
significant bits of the effective digit number Fe can be used as the sign bit. 

[0140] In case of using "the effective digit number Fe, when a reconstructed prediction error signal of the immediately 
preceding frame is required for the analysis processing and filtering in the spectral envelope calculating part 432, the 
10 inverse filter 434, the synthesis filter 435, the synthesis filter 502 and the synthesis filer 435' in the missing information 
compensating part 430 ot= the decoder 20 (Fig. 25), prior to the processing the effective digit numbers Fe of the imme- 
diately preceding frame should equal the current frame. For example, when the effective digit number of the current 
frame is larger than the ©T=fective digit number of the immediately preceding frame by M bits (digits), the amplitude bits 
sequences of the immed i ately preceding frame, for instance, are each download shifted by M bits to reduce the am- 
is plitude value of the amp I inude bit sequence of the previous frame to meet the effective number of digits of the imme- 
diately preceding frame with the effective number of digits of the current frame. When the effective digit number of the 
current frame is smaller t Kian that of the immediately preceding frame by N bits (digits), the amplitude bit sequence of 
the immediately preceding g frame is temporarily upward shifted by M digits. For example, in the floating-point repre- 
sentation to increase the amplitude value of the amplitude bit sequence of the immediately preceding frame, the ef- 
20 fective digit number equ&l to that of the current frame. Alternatively, the processing is carried out by using the other 
preceding frame, rather t frnan the immediately preceding frame. 

[0141] In case of making the effective digit numbers of the current and immediately preceding frames equal to each 
other, the amplitude bit sequence of the immediately preceding frame is subjected to the above adjustment in the 
effective digit number imr-nediately prior to steps S2 and S4 in Fig. 22, S2, S3, S5 and S6 in Fig. 24 and S2, S3 and 
25 S6 in Fig. 26 as indicated* by the broken lines. In the missing information compensating part 430 in Figs. 23 and 25, 
the amplitude bit sequence of the immediately preceding frame needs only to be subjected to above adjustment to its 
effective digit number. As- shown in the decoder 20 in Fig. 21 , the amplitude bit sequence from the rearrangement part 
220 may also be digit-ad j Listed in the digit adjusting part 460, in which case there is no need for the above-mentioned 
correction of the effective digit number. 

30 

EMBODIMENT 7 

[0142] It is customary in the prior art that the high-compression-ratio coding of an acoustic signal is designed to 
minimize perceptual distortion in view of the perceptual characteristics. This is a coding scheme that utilizes perceptual 
35 optimization, and is inten died to minimize a perceptual quantization distortion by use of frequency masking. To minimize 
the energy of quantization distortion independently of the perception, the quantization distortion is dispersed or dis- 
tributed independently of= the magnitude of the spectrum of the original sound. 

[0143] In a perceptual optimization, since the quantization distortion around a major spectrum component of the 
original sound is masked by the component of the original sound and is not perceived, the amount of distortion is made 

40 near the major spectrum component of the original sound but small near its small spectrum component. 

[0144] For example, in the combination of high-compression-ratio irreversible coding and coding as in the Fig. 11 
embodiment, if the perceptual characteristics is considered in the irreversible coding, the waveform of the locally re- 
constructed signal (the o utput from the inverse quantization part 130 in Fig. 11) is seriously distorted particularly in a 
relatively large spectrum component. Consequently, the error signal between the locally reconstructed signal and the 

45 original input acoustic sig nal is relatively large in its amplitude variation; hence, even the reversible compression coding 
by the afore-mentioned i-earrangement does not sufficiently increase the coding efficiency. Fig. 27 illustrates in block 
form a seventh embodinr*ent of the present invention intended to overcome the above-mentioned problem. 
[0145] In the coder 10 .^m acoustic signal sample sequence input to the input terminal 100 is separated by the frame 
forming part 110 into fra. mes each consisting of, for example, 1024 samples. The acoustic signal of each frame is 

so applied to a perceptual optimization coding part 13, wherein it is subjected to Irreversible compression coding taking 
the perceptual characteristics into account. The perceptual optimization coding is compression coding of the acoustic 
signal so as to minimize^ perceptual distortion; for example a coding scheme specified in MPEG can be used. The 
perceptual optimization coding part 13 outputs a perceptually optimized code Ina that is an irreversible code. 
[0146] The perceptuall y optimized code Ina is locally reconstructed in a local decoding part 14 to provide a locally 

55 recommended signal. Tr-» e locally reconstructed signal for the code Ina can be obtained in the perceptual optimization 
coding part 13 due to its ana lysis-by-synthesis coding scheme. The locally reconstructed signal is fed to a modification 
part 15, wherein it is modified so that the difference or error between it and the output acoustic signal from the frame 
forming part 110 is small . That is r the error between the locally reconstructed signal modified in the modification part 
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1 5 (a modified local signal) and the acoustic signal from the frame forming part 11 0 is calculated in an error calculating 
part 16. The locally reconstructed signal is modified in the modification part 15 so that the energy of the error signal 
may preferably be minim ized. 

[0147] This modificatio n is carried out by multiplying the locally reconstructed signal by a modification parameter 
s generated in a modificat ion parameter generating part 17 : or by weighted addition of plural samples to the locally 
reconstructed signal. The modification parameter is generated, for example, in the manner described below. 
[0148] Set a p-order m odification parameter A( 1 xp), an input acoustic signal X(1 xn) consisting of n samples and 
a locally reconstructed si gnal matrix Y(pxn) as follows: 

10 T 

A=(a 0 ,a n a (p . 1) 
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where ( ) T represents tra reposition of the matrix. 
25 [0149] The energy d ot= the error signal is as follows: 



d=(X-YA) T (X-YA) (2) 



30 [0150] The modified parameter A that minimizes d is as follows: 

A=(Y T Y)* 1 Y T X (3) 



(Y T Y) is an auto-correlation matrix, Y T X can approximates a cross correlation energy, and the modified parameter a 0 
when p=1 is a normalization of the cross correlation coefficient between X and Y by the energy of Y. 
[0151] Further, the correlation coefficient b between U(=X-Y) and Y is calculated and the following Z can be used as 
the error signal. 

Z= X-Y-bY (4) 



That is, Z=X-(1+b)Y^X-s 0 Y. 

[0152] In the modified parameter generating part 17, as shown in Fig. 28A, the cross correlation vector between the 
input acoustic signal X ainda transposed matrix of the locally reconstructed signal Y is calculated in a multiplication 
part 1 71 , the auto correlation matrix Y^Y is calculated in a multiplication part 1 72 and the result of calculation in the 
multiplication part 171 is divided by the result of calculation in the multiplication part 172 in a division part 173 to 
generate the modified parameter A. Alternatively, the modified parameter &q may be obtained by calculating the cross 
correlation coefficient between X and Y in the multiplication part 171 and the energy of Y in the multiplication part 1 72 , 
and dividing the cross correlation coefficient by the energy of Y in the division part 173. 

[0153] The modified parameter a 0 may also be obtained, as depicted in Fig. 28B, by calculating X-Y=U in a subtraction 
part 174 and the cross o orrelation coefficient b between U and Y in a multiplication part 175 and adding 1 to b in an 
addition part 1 76. 

[0154] The modified p> arameter A, a 0 , or b are encoded and output as a modified parameter code Inm from the 
modified parameter generating part 171 . Thus, the modified parameter contains the cross correlation component be- 
tween the acoustic signa I X and the locally reconstructed signal Y, and in the modifying part 1 5 the locally reconstructed 
signal Y is multiplied by tine modified parameter or a weighted addition or convolution of the locally reconstructed signa I 
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by the modified parameters A. 

[0155] Incidentally, if th* e energy of the error signal between the acoustic signal and the locally reconstructed signal 
is minimized, the error s i eg nal has no correlation to the acoustic signal and the locally reconstructed signal. If the energy 
of the error signal is not minimized, there is correlation between the error signal and the acoustic signal and the locally 
5 reconstructed signal. Thi s correlation component is calculated; the locally reconstructed signal Y is modified by Eq . 
(3) in accordance with th « correlation component and the modified parameters A of Eq. (2) is determined which min- 
imizes the energy of the ^rror signal. 

[0156] The generation of the modified parameters A may also be performed by setting a proper value at first and 
sequentially correcting it for each frame so that the amplitude or energy of the error signal U may decrease. In this 

10 instance, the modified pa rameter code Inm need not be output. 

[0157] The error sign a ■ from the error calculating part 1 6 is reversibly encoded in a reversible coding part 1 8, from 
which it is output as a re>A/ersibly encoded code Pne. The reversible coding can be done by a combination of the bit 
rearrangement with Huff man coding, arithmetic coding, or simitar entropy coding as described in Japanese Patent 
Application Laid-Open G ^zette No. 2001-44847 referred to previously with reference to Figs. 1 and 2. 

is [0158] Since the locally^ reconstructed signal is modified in the modifying part 15 so that the error between it and the 
acoustic signal becomes small, the number of "0" bits in the error signal is larger than in the error signal between the 
unmodified locally reconstructed signal and the acoustic signal; hence, the modification of the locally reconstructed 
signal provides increasecrJ efficiency in the reversible coding of the error signal. 

[0159] The perceptually optimized code Ina, the reversibly encoded code Ine and, if necessary, the modified param- 

20 eter code Inm are comb in ed in a combining part 320. Incidentally, it is also possible to adopt a scheme that, as depicted 
in Fig. 28B, multiplies the locally reconstructed signal Y by a modified parameter b in the modifying part 15 to obtain 
a modified locally reconstructed signal bY, calculates an error U-bY between the modified locally reconstructed signal 
bY and U=X-Y in the erro r calculating part 16 to obtain an error signal and reversibly encodes it. Since this error signal 
is essentially identical vvitr h the error signal A=X-a 0 Y, the calculation of the error signal between the acoustic signal and 

25 the modified locally reconstructed signal means the both schemes and a scheme equivalent thereto. 

[0160] In the decoder 2 O, the set of codes for each frame input to the input terminal 200 is separated by the separation 
part 440 to the perceptually optimized code Ina, the reversibly encoded code Ine and, if necessary, the modified pa- 
rameter code Inm. The foerceptually optimized code Ina is irreversibly decoded in an perceptually optimized code 
decoding part 23 to gene rate a decoded signal. The scheme for this decoding is identical with the scheme used in the 

30 local decoding part 1 4 of the coder 1 0. The decoded signal is modified in a modifying part 24 through multiplication by 
a constant or plural-sampz>le weighted addition. This modification is also identical with that in the modifying part 15 of 
the coder 10. When the tnodified parameter code Inm is input thereto, a modification parameter generating part 25 
decodes it to generate th» e modification parameters A or ao or b. When the modified parameter code Inm is not input 
thereto, the modified par-ameter generating part 25 uses the decoded signal Y and the reconstructed acoustic signal 

35 x to calculate the modified parameters A by sequential correction using the scheme identical with that used by the 
modification parameter cp enerating part 17 of the coder 10. 

[0161] The reversibly encoded code Ine is reversibly decoded in a reversible decoding part 21 to reconstruct the 
error signal A. The error signal A and the modified decoded signal aY are added together in an addition part 27 to 
reconstruct the acoustic signal. The reconstructed acoustic signal is applied via a switching part 28 to the frame com- 
40 bining part 250, wherein t-econstructed acoustic signals of respective frames are sequentially concatenated, thereafter 

being output therefrom. I Ipon detection of a correctable or compensable packet erasure by the erasure detecting part 

420, such a compensation as described previously in respect of Fig. 23, for instance, is carried out by the information 
compensating part 480. 

[0162] When the reversibly encoded code Ine is not input, or when the error signal A of satisfactory quality cannot 
45 be obtained due to a erasure of some amount of information, it is detected by the erasure detecting part 420, and the 
detected output is used t « control the switching part 28 ; through which the decoded signal from the perceptually opti- 
mized code decoding pa rt 23 is applied to the frame combining part 250. For ultimate reversible coding, the smaller 
the energy of the quantised error is, the higher the compression efficiency is; but when information about onfy the 
perceptually optimized code ina is available, the use of the quantization result which minimizes perceptual distortion 
50 improves the signal quali ty despite 1 bit rate. In a decoder without the reversible decoding part 26 and so on, too, the 
perceptually optimized code Ina can be decoded into a reconstructed digital signal. 

EMBODIMENTS 

55 [0163] Fig. 29 illustrate* s in block form an eighth embodiment of the present invention, in which the parts correspond- 
ing to those in Fig. 27 are identified by the same reference numerals. The coder 10 differs from the counterpart 10 of 
the Fig. 27 in the constru «stion of the modifying part 15. That is, in this embodiment the error signal between the locally 
reconstructed signal Y from the local decoding part 14 and the acoustic signal X is calculated in an error calculating 
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part 15A. The error signal is subjected to irreversible compression coding in an error minimization coding part 15B so 
that the energy of quantised error becomes minimum, and an error minimized code Inp is provided as the irreversibly 
encoded code. 

[0164] The error minimi ized code Inp is locally decoded in a local decoding part 15C, and the locally reconstructed 
5 signal and that from the local decoding part 14 are added in adding part 15D. The error between the added locally 
reconstructed signal and the acoustic signal is calculated in the error calculating part 16, from which an error signal is 
provided to the reversible coding part 18. Since the acoustic signal is encoded twice in the perceptual optimization 
coding part 13 and the error minimization coding 15B as described above, the locally reconstructed signal, that is, the 
added locally reconstructed signal from the adding part 1 5D is close to the acoustic signal accordingly, and the number 
10 of "0" bits in the error signal from the error calculating part 16 increases correspondingly. The combining part 320 
combines the perceptual ly optimized code Ina, the error minimized code Inp and the reversibly encoded code Ine. 
[0165] In the decoder ^0 the error minimized code Inp is irreversibly decoded in an error minimized code decoding 
part 24A, and the reconstructed signal from the decoding part 24A and the reconstructed signal from the perceptually 
optimized code decoding part 23 are added together in an adding part24B. The added signal is applied via the switching 
15 part 28 to the adding part 27, wherein it is added to the reconstructed error signal from the reversible decoding part 
26. When the reversibly encoded code Ine is not input or when sufficient information for reconstructing the error signal 
is not available, switching part 28 applies the decoded signal of the perceptually optimized code Ina as the reconstructed 
acoustic signal to the f ra rne combining part 29 in place of the added decoded signal from the adding part 24B. The 
error minimized code decoding part 45 and the adding part 24B constitute the modifying part 24. 

20 

EMBODIMENT 9 

[0166] Fig. 30 illustrates in block form a ninth embodiment of the present invention. This embodiment differs from 
the Fig. 27 embodiment in the construction of the modifying part 15 of the coder 10 and in the provision of an error 

25 minimization coding part 1 9 and in the corresponding modifications of the decoder 20. 

[0167] In the coder 1 0 the acoustic signal for each frame is subjected to irreversible compression coding in the error 
minimization coding part 19 in such a manner as to minimize the energy of quantized error, and the error minimized 
code Inp is output as the i rreversibly encoded code. The error minimized code Inp is locally decoded in a local decoding 
part 15E, and the locally reconstructed signal and that from the local decoding part 14 are applied to a weighted 

30 averaging part 1 5F wh ic Ki obtains a weighted average of them placing emphasis on the former. An error between the 
weighted mean locally reconstructed signal and the acoustic signal is calculated in the error calculating part 16, and 
the error signal is appliecd to the reversible coding part 18. 

[0168] The weight in thi e weighted averaging part 1 5F is a statistically pre-calculated value such that the error signal 
from the error calculating part 16 becomes small; it is set to, for example, approximately 0.8 to 0.9 for the locally 

35 reconstructed signal of tlie error minimized code, and around 0.1 to 0.2 for the locally reconstructed signal for the 
perceptually optimized code. Alternatively, the both locally reconstructed signals and the acoustic signal are input to 
the modified parameter generating part 17, wherein both weights are determined by solving simultaneous equations 
so that the error signal from the error calculating part 1 6 becomes minimum. In this case, the both weights are encoded 
and a weight code Inw is output. The local decoding part 15E and the weighted averaging part 15F constitute the 

40 modifying part 15. 

[0169] The combining foart 320 combines the perceptually optimized code lna : the error minimized code Inp and the 
reversibly encoded code Ine, and output a combined output. In case of using the modified parameter generating part 
17, the combining part 3 20 combines the weighted code Inw as well as the above-mentioned codes. The perceptual 
optimization coding part 13 and the error minimization coding part 19 may sometimes share such parameters as the 

45 spectral envelope and power. In such case, as indicated by the broken lines, a common coding part 13A for encoding 
a parameter common to both of them is placed in the one coding part, in the illustrated example, in the perceptual 
optimization. coding part 13, and the common coding part 13A outputs the parameter as a common code Inc and 
provides, as required, th& extracted common parameter to the other coding part, that is, in the error minimization coding 
part 19 in this case. Mor-eover, a coding part 13B placed in the perceptual optimization coding part 13 encodes, for 

so example, waveform information of the input acoustic signal by vector quantization taking the perceptual characteristics 
into account, and outputs a code Inar. Further, a coding part 19A in the error minimization coding part 19 similarly 
encodes the waveform information of the acoustic signal as by vector quantization so as to minimize the energy of the 
quantized error and outp uts a code Inpr. 

[0170] In the decoder SO the error minimized code Inp separated in the separation part 440 is irreversibly decoded 
55 jn the error minimized code decoding part 24A, and the decoded signal and the decoded signal from the perceptual 
optimization coding part S3 are applied to a weighted averaging part 24C, which conducts a weighted addition biased 
toward the former. The w eighted signal is provided to the adding part 27, wherein it is added to the reconstructed error 
signal from the reversibl e decoding part 21, and the added signal is applied via the switching part 28 to the frame 
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combining part 250. The weight in the weighted averaging part 24C is set to the same weight as that in the weighted 
averaging part 15F of the coder 10. When the weight is determined in the modified parameter generating part 17 of 
the coder 10, the weight code Inw separated in the separation part 440 is decoded in a weight decoding part 29, and 
the reconstructed weight is supplied to the weighted averaging part 24C. The reconstructed signal of the perceptually 

5 optimized code Ina and the reconstructed signal of the error minimized code Inp are applied to another weighted 
averaging part 26 as well , which obtains a weighted average biased toward the former (Ina decoded signal). The weight 
for this weighted averaging is fixedly set to about 0.8 to 0.9 for the Ina decoded signal and about 0.2 to 0.9 for the Inp 
decoded signal. Alternatively, the weight reconstructed in the weight decoding part 29 may be provided to the weighted 
averaging part 26 in a re I stion inverse to the weighting in the weighted averaging part 24C. 

10 [0171] When the reversibly encoded code Ine is not input or when sufficient information for reconstructing the error 
signal in the reversible decoding part 21 is not available, the averaged decoded signal from the weighted averaging 
part 26 is provided as a reconstructed acoustic signal via the switching part 28 to the frame combining part 250. When 
the common code Inw is separated in the separation part 440, it is decoded in a common decoding part 22. A common 
reconstructed signal is ap> plied to the perceptual optimization decoding part 23 and the error minimized code decoding 

15 part 24A. These decodin g parts 23 and 24A are supplied with the codes Inar and Inpr, respectively, and provide desired 
decoded signals. The error minimized code decoding part 24A and the weighted averaging part 24C constitute the 
modifying part 24. 

EMBODIMENT 10 

20 

[01 72] Fig. 31 illustrates in block form a tenth embodiment of the present invention, in which the parts corresponding 
to those in Fig. 30 are identified by the same reference numerals. In the coder 10 of this embodiment, the locally 
reconstructed signal for t tne error minimized code Imp is applied directly to the error calculating part 16 from the local 
decoding part 15E. Acco rdingly, the perceptually optimized code Ina is not locally decoded, but instead the result of 
25 local decoding of the error minimized code Inp is used for the error calculation in the error calculating part 16. As the 
case with Embodiment 9, this embodiment may also be adapted so that one of the perceptual optimization coding part 
13 and the error minimiz .ation coding part 19 extracts parameters common to both of them for their coding and that 
they output the common code Inw and the codes Inar and Inpr of their own. 

[0173] In the decoder ^0 the decoded signal from the error minimized code decoding part 24A is applied directly to 
30 the adding part 27, wher-ein it is added to the reconstructed error signal from the reversible decoding part 21. The 
switching part 28 switches between the perceptually optimized code decoding part 23 and the adding part 27 and 
applies the reconstructed signal from the former or the added signal from the later as the reconstructed acoustic signal 
to the frame combining psrt 250. The operation in the case of the common code Inc being separated in the separation 
part 440 is the same as described previously with reference to Fig. 30. 

35 

EMBODIMENT 11 

[0174] Fig. 32 illustrates in block form an eleventh embodiment of the present invention, in which the parts corre- 
sponding to those in Fig. 30 are identified by the same reference numerals. In the coder 10 of this embodiment: the 

40 perceptual optimization c oding part 1 3 in the Fig. 30 embodiment is connected to the output side of the error calculating 
part 1 6; the error between the locally reconstructed signal of the error minimized code Inp from the local decoding part 
15E and the acoustic si^ nal is calculated in the error calculating part 16; the error signal is subjected to lossy com- 
pression coding in the perceptual optimization coding part 13 in a manner to minimize perceptual distortion; and this 
lossy code is output as the perceptually optimized code Ina. In the combining part 320 the error minimized code Inp, 

45 the perceptually optimized code Ina and the lossless code Ine are combined, and the combined output is provided. 
[0175] In the decoder SO the separated perceptually optimized code Ina is subjected to lossy decoding in the per- 
ceptual optimization deco ding part 23, and this lossy decoded signal and the reconstructed signal of the error minimized 
code Inp by the error minimized code decoding part 24A are added in an adding part 24B. The reconstructed signal 
of the error minimized cocde Inp and the lossless reconstructed signal of the lossless code Ine, that is, the reconstructed 

50 error signal, are added together in the adding part 27, from which the added signal is applied as a reconstructed 
acoustic signal to the frame combining part 250 via the switching part 28. When no error signal is reconstructed in the 
lossless decoding part 2~i , the added reconstructed signal from the adding part 24B is supplied as the reconstructed 
acoustic signal to the frame combining part 250 via the switching part 28. 

[01 76] This embodiment is also common to the eighth to tenth embodiments in that the lossless coding part 1 8 uses, 
55 for the lossless compression coding, a quantization sequence which minimizes the energy of the quantized error and 
that when only information for the lossy compression coding is available, use is made of the result of quantization 
which minimizes percept *jal distortion. In this embodiment however, the quantization for minimizing perceptual distor- 
tion is further carried out in the perceptual optimization coding part 13, that is, multi-stage quantization is performed. 
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This increases the numb er of coded bits as a whole but achieves improvement in terms of auditory sensation and 
provides increased efficiency in the optimization of distortion energy, too, as compared with the use of the locally 
reconstructed signal at trt « first stage, that is, the locally reconstructed signal of the error minimized code Inp from the 
local decoding part 15E. For optimization of distortion energy, it is advisable to use the more efficient scheme. 

s [0177] The scheme in t his case will be described below in respect of the broken-lined configuration in Fig. 32. The 
code Ina from the percept ual optimization coding part 13 is locally decoded in the local decoding part 14, and the locally 
reconstructed signal is applied to an adding part 31 , wherein it is added to the code Inp from the local decoding part 
15E. The error between tfrie added locally reconstructed signal and the acoustic signal is calculated in an error calcu- 
lating part 32. The error signal and the error signal, from the error calculating part 16 are compared in a comparison 

10 part 33, and the smaller one of them is selected in the select part 34 and supplied to the reversible coding part 1 8. At 
this time, a select code Ins is output which indicates which of the error signals has been selected. 
[0178] In the decoder 20 a select part 41 is controlled by a select signal Ins separated in the separation part 440. 
When the error signal fro m the error calculating part 1 6 is selected in the coder 10, the reconstructed signal from the 
error minimized code decoding part 24A is selected and applied to the adding part 27. When the error signal from the 

is error calculating part 32 is selected in the coder 1 0, the added reconstructed signal from the adding part 24B is selected 
and applied to the adding part 27. 

[0179] Fig. 33 illustrat&s in block form a concrete example of the reversible coding part 18 used in Figs. 27 to 32. 
The illustrated conf igurat i on is substantially the same as that shown in Fig. 1 4 which is composed of the rearrangement 
part 1 60, the transmiss i o r— i /recording unit separation part 31 0, - the lossless coding part 1 50 and the auxiliary information 

20 generating part 350. The- error signal from the error calculating part 16 is applied to the rearrangement part 160 and 
the auxiliary information g enerating part 350. In the effective digit number detecting part 353 of the auxiliary information 
generating part 35 the digit number, which represents the maximum value of the absolute value of the error signal for 
each frame, is detected as the effective digit number Fe. As described previously with reference to Figs. 1 5A and 1 5B, 
bits of respective sampl&s (amplitude bit sequences) of the error signal at the bit positions common thereto, only in 

25 the portion or range def i r» ed by the effective digit number, are concatenated across the frame to form equi-position bit 
sequences. 

[01 80] The equi-positio n bit sequences from the rearrangement part 1 69 are separated by the transmission/recording 
unit separating part 310 ~X.o pieces of transmission unit or recording unit data. Each of the separated pieces of trans- 
mission/recording unit data is, if necessary, subjected to lossless compression coding in the lossless coding part 150, 

30 from which it is output as the error code Ine. 

[0181] On the other haL nd, the effective digit number Fe detected in the effective digit number detecting part 353 is 
provided to the auxiliary i ■^formation coding part 352. In this embodiment, the error signal sample sequence is provided 
to the spectral envelope calculating part 351 , wherein it is subjected to, for example, linear prediction coding analysis 
for each frame, and the spectral envelope parameters LPC are obtained as linear prediction coefficients. And the 

35 average power of the error signal for each frame is calculated in the power calculating part 354. Alternatively, the error 
signal is input to the inverse filter 355 formed based on the linear prediction coefficients calculated in the spectral 
envelope calculating part 354, by which the spectral envelope of the error signal is flattened, and the average power 
of the flattened signal is calculated in the power calculating part 356. These effective digit number Fe, linear prediction 
coefficients LPC and ave r-age power are encoded with low bits, for example, approximately 30 to 50 bits in the auxiliary 

40 information coding part 352, from which auxiliary information Inx is provided. The auxiliary information Inx encoded 
from the effective digit number, the spectral envelope parameters and the average power is fed to the combining part 
420 (Figs. 27 and 29 to »2), wherein it is added to a representative packet of each frame or added in a packet having 
loaded therein the transmission/recording unit data containing the sign bit and from which it is output as such or as an 
independent packet. 

45 [0182] Fig. 34 illustrates in block form a concrete example of the lossless decoding part 21 of the decoder 20, together 
with the information correcting part 480. In the separating part 440 the auxiliary information Inx and the error code Ine 
are separated from the i nput packet Pe. The error code Ine is provided to the lossless decoding part 210, and the 
auxiliary information Inx i s provided to the auxiliary information decoding part 450. The auxiliary information decoding 
part 45 decodes the effex^ive digit number Fe, the spectral envelope coefficients LPC and the average power of the 

50 frame concerned, and provides the effective digit number Fe to the digit adjusting part 460 and the spectral envelope 
parameters and the aver* age power to the missing information compensating part 430. Since the operations of these 
respective parts have already been described with reference to the Fig. 1 4 embodiment, no description will be repeated. 
[0183] The lossless co ding part 18 of the coder 10 in the embodiments of Figs. 27 to 32 may also be adapted to 
further perform prediction processing for the error signal. An example of its configuration is shown in Fig. 35A. The 

55 error signal is applied to "the spectral envelope calculating part 351 , which calculates the linear prediction coefficients 
LPC representing the spectral envelope of the error signal. On the other hand, the error signal is applied to the prediction 
error generating part 370 , from which the prediction error signal Spe if provided. For example, a plurality of immediately 
preceding error signal sa.mples from the error calculating part 16 are supplied from the register 371 to the linear pre- 
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diction part 372, wherein 1: hey are multiplied by the linear prediction coefficients LPC representing the spectral envelope 
from the spectral envelope e calculating part 351 to obtain a linear prediction value. The linear prediction value is fed to 
the integer part 373, whe rein it is put to an integral value. The difference between the integral prediction value and the 
current sample of the error signal from the error calculating part 1 6 is calculated in the difference circuit 374 to obtain 
the prediction error signal Spe. The prediction error signal Spe is input to the rearrangement part 160. 
[0184] Fig. 35B depicts an example of the configuration of the iossless decoding part 21 of the decoder 20 in the 
case of applying the Fig . 35A configuration to the lossless coding part 1 8 of the coder 10. The illustrated configuration 
identical with that compo -sed of the rearrangement part 220, the missing information compensating part 430, the aux- 
iliary information decodin g part 450 and the synthesis filter 470 in the decoder 20 shown in Fig. 21 . The reconstructed 
prediction error signal Sp e from the information correcting part 480 is applied to the synthesis filter 470, wherein it is 
subjected to processing i nverse to that in the prediction error generating part 370 of the lossless coding part 18 in Fig. 
35A. That is, a predetermined constant number of immediately preceding reconstructed samples are input from the 
register 471 to the linear prediction part 472 : wherein they are respectively multiplied by weights based on the linear 
prediction coefficients LF=*C decoded in the auxiliary information decoding part 450, and the sum of the results of mul- 
tiplication is obtained as a predicted value of the current decoded sample. The predicted value is put to an integral 
value in the integer part **X73. The integral predicted value and the current prediction error signal from the information 
correcting part 480 are added together in the adding part 474, whose output is used as the output fro the synthesis 
filter 470, that is, as the reconstructed error signal. 

EMBODIMENT 12 

[0185] While the embodiments described above are directed to the coder and the decoder for the one-channel digital 
input signal, the embodirment are applicable as well to multi channel signals. There have been developed several 
compression coding sch «mes for multi-channel signals, such as AC-3 (Audio Coding by Dolby, Inc.etc.) and AAC 
(Advanced Audio Coding by Dolby, Inc.etc.) With these conventional schemes, perceptual distortion can be reduced 
substantially but the wav ^form appreciably differs from that of the original waveform. When multi-channel signals are 
transmitted intact in a POM (Pulse Code Modulation) form, the original sound can completely be reconstructed : but a 
large amount of informati on is necessary. Further, no sound can be reconstructed by some part of its code sequence, 
and on this account, in tr-i e case of packet transmission of the PCM signal, a packet erasure seriously contributes the 
deterioration of the souncd quality. 

[0186] It is possible to enhance the coding efficiency by mixing multi-channels signals to reduce the number of chan- 
nels for coding. In this case, however, the original multi-channel signals cannot be reconstructed correctly. 
[0187] This embodiment offers multi-channel signal coding and decoding methods and a coder and a decoder there- 
for, which: mix digital sigmals of plural channels and encode them into digital signals of a smaller number of channels; 
increases the coding efficiency, enables original digital signals of plural channels to be reconstructed with high fidelity; 
permit selection of the bi~t rate over a wide range; and allow selection of the number of channels over a wide range. 
[0188] Fig. 36 illustrat&s in block form a coder and a decoder according to this embodiment. In the coder 10, digital 
signals of M (M being an i nteger equal to or greater than 2) channels are input to the frame forming part 1 1 0 via terminals 
100., to 100 M , wherein tri ey are separated for each frame, for example, every 1024 samples. The digital signals sep- 
arated are applied to a signal mixing part 30, wherein they are mixed with digital signals of M channels smaller in 
number than M. N is an i nteger equal to or greater than 1 . and N<M. The mixed N-channel signals are subjected to 
lossy or lossless compression coding in a coding part 120, from which a main code Im is output. This coding may 
preferably be high-comp r-ession-ratio coding. The main code Im is decoded in a local decoding part 130 : from which 
a locally reconstructed si gnal is provided. This locally reconstructed signal is applied to a channel expansion part 40, 
wherein It is converted tc=> locally reconstructed signals of the original M channels. This locally reconstructed signals 
for the code Imcan be ototained in the coding part 120 due to its analysis-by-synthesis coding scheme. 
[0189] In the signal mi :*ing part 30 an average signal of those of first four of ; for example, eight channels may be 
used as a left-channel signal and an average signal of those of the other four channels may be used as a right-channel 
signal. Alternatively, an average signal of two-channel signals is used as a one-channel monaural signal. 
[0190] In the channel expansion part 40 the locally reconstructed signal is converted to signals of the original chan- 
nels. The locally reconstructed signals of the increased number of channels have some information of the input digital 
signals lost due to reduction in the number of channels in the mixing part 30. The missing signals are calculated as 
error signals in an error calculating part 134 which is supplied with the M-channel digital signals branched from the 
frame forming part 1 1 0 amd the M-channel locally reconstructed signal. The error signals are applied to a bit sequence 
converting part 50, wher~ein they are subjected to bit sequence rearrangement and compression coding, and from 
which an error code Ine amd an auxiliary information code Inx are output. Although a concrete configuration and process- 
ing of the bit sequence converting part 50 will be described, it is equipped with at least the rearrangement part 160 for 
conversion to equi-position bit sequences as described previously with reference to Figs. 4A and Figs. 15A and 15B. 
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The error code Ine and t i~ie auxiliary information Inx from the bit sequence converting part 50 and the main code Im 
from the coding part 120 .sre combined in the combining part 320, from which the combined output is provided. When 
the combined output is sent out as a packet Pe, it is added with the header 31 referred to previously in connection with 
Fig.4B. 

s [0191] In the decoder ^ 0 the input packet P2 is separated by the separating part 440 to the main code Im, the error 
code Ine and the auxiliary information Inx in this case. The main code Im is decoded in a decoding part 60 by a decoding 
scheme corresponding te> the coding scheme of the coding part 120 in the coder 10. The decoded signals from the 
decoding part 1 20 are pro ^s/ided to a channel expansion part 80, wherein they are converted from the N-channel decoded 
signals to M-channe! deer oded signals. 

w [0192] The error code 1 ne is processed in a bit sequence inverse conversion part 70 to reconstruct the M-channel 
error signals. Although the configuration and operation of the bit sequence inverse conversion part 70 will be concretely 
described, it is equipped with at least the rearrangement part 220 referred to previously with reference to Figs. 4A, 
15A and 15B, and reconstructs error signals each composed of amplitude bit sequences. The auxiliary information Inx 
is decoded in the inform action correcting part 440 . and when a packet erasure is detected in the erasure detecting part 

15 420, the reconstructed error signal is corrected in the information correcting part 480 based on the auxiliary information. 
[0193] The reconstructed M-channel error signals and the reconstructed signals of increased M channels are added 
for channel in the adding* part 240, from which the added outputs are provided as reconstructed digital signals of M 
channels to the frame co mbining part 250, from which frame-concatenated digital signals of the respective channels 
are output 

20 [0194] With the above— described configuration, when the main code Im, the error code Ine and the auxiliary infor- 
mation Inx are input to thi ^ decoder 20 with erasure of a number small enough to obtain the reconstructed signal and 
the reconstructed error si ^na\, the original M-channel digital signals can be reconstructed with high fidelity. The coding 
efficiency can be change <zJ, as required, by selecting the number of channels to be decreased in the signal mixing part 
30. When no packet is inp=Dut or when no sufficient amount of information for reconstructing the error signal is available, 

25 }t is possible to obtain si g »nals of appreciable quality by applying the M-channei reconstructed signals as reconstructed 
digital signals to the frarr* e combining part 250 from the channel expansion part 80. 

[0195] In the Fig. 36 ei — nbodiment the mixing operation in the signal mixing part 30 may be performed in a plurality 
of stages. An example w ill be described below with reference to Fig. 37, in which the parts corresponding to those in 
Fig. 36 are identified by tine same reference numerals. In this example, signal mixing takes place in two stage, that is, 
so in signal mixing parts 30 snd 41 . For instance, original M=8 channel stereo digital signals are mixed with N=2 channel 
or N=4 channel stereo di s> tal signals, and the thus mixed stereo digital signals are mixed with L=1 channel monaural 
digital signals. The mixec* signal from the signal mixing pari 41 is encoded in the coding part 1 20, from which the main 
code Im is output. 

[0196] The main code Im is reconstructed in the local decoding part 130, and the locally reconstructed signal is 
35 provided to the channel i ■ — icreasing part 42, wherein it is converted from L to N channels. The error signal between the 
N-channel locally reconstructed signals and the N-channel digital signals from the signal mixing part 30 are calculated 
in an error calculating par — 1 120. The error signals are subjected to lossy or lossless, preferably, high-compression-ratio 
coding in a coding part 4—4, from which they are output as a sub-code le. 

[0197] The sub-code is decoded in a local decoding part 45 into N-channel locally reconstructed signals, which 
40 are added to the N-chanr> el locally reconstructed signals from the signal mixing part 42 in an adding part 46. The added 
N-channel locally reconstructed signals are converted to M-channel added locally reconstructed signals in the channel 
expansion part 40. Error signals between the M-channel added locally reconstructed signals and the M-channel digital 
signals from the frame f canning part 110 are calculated in the error calculating part 140, from which the error signals 
are provided to the bit s^^quence converting part 50. The error code Ine and the auxiliary information Inx from the bit 
45 sequence converting pai~» 50, the main code Im from the coding part 120 and the sub-code le from the coding part 44 
are combined in the com toining part 320, from which they are output as a packet. 

[0198] In the decoder ^0 the main code Im and the sub-code le separated by the separating part 440 are recon- 
structed in decoding part^ 60 and 61 . respectively, and the error code Ine is fed to the bit sequence inverse conversion 
part 70, wherein it is inv^srsely rearranged to reconstruct the error signals. The L-channel reconstructed signal from 

so the decoding part 60 is cc=»nverted to N-channel reconstructed signals in the channel expansion part 80. The N-channel 
reconstructed signals an d the N-channel reconstructed signals from the decoding part 61 are added together in an 
adding part 62. The N-cl — lannel added reconstructed signals are converted to M-channel reconstructed signals in a 
channel increasing part S3, and the N-channel reconstructed signals and the M-channel error signals are added to- 
gether in the adding part 240, from which reconstructed digital signals are applied to the frame combining part 250. 

55 [0199] In this instance, the bit rate can be chosen over an approximately 60-fold range from 8 kbit/s to 5 Mbit/s. 

[0200] In Figs. 36 and C37, in the case of generating the packet Pe in the combining part 320, it is preferable that the 
highest priority level be g i ~ven to the packet containing the main code Im. The packet containing sub-code le is assigned 
the highest priority level mext to the packet containing the main code Im. 
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[0201] The lossless cocding part 18 described previously with reference to Fig. 33 : for instance, can be used intact 
as the bit sequence conv orting part 50 in the coder 1 0. In such a case, the bit sequence inverse conversion part 70 in 
the decoder 20 may be identical in construction with the lossless decoding part 21 described previously in respect of 
Fig, 34, for example. 

s [0202] Alternatively, the lossless coding part 1 8 in Fig. 35A may be used as the bit sequence converting part 50. In 
this instance, the bit sequence inverse conversion part 70 in the decoder 20 may be identical in construction with the 
lossless decoding part 2~l in Fig. 25B, for instance. 

EMBODIMENT 13 

10 

[0203] When multi-cha. nnel signals are transmitted intact in PCM (Pulse Code Modulation) form, the original sound 
can completely be reconstructed, but a large amount of information is necessary. Further, no sound can be reconstruct- 
ed by some part of its co de sequence, and on this account, in the case of packet transmission of the PCM signal, a 
packet erasure contributes serious degradation of sound quality. 
15 [0204] This embodiment is intended to offer coding and decoding methods, a coder and a decoder that make multi- 
channel digital signals insusceptible to the influence of information erasure and make it possible to select the degree 
of information compress i on over a relatively wide range. 

[0205] Turning to Fig. C38, a description will be given of the coder 10 and decoder 20 according to this embodiment. 
[0206] In the coder 1 0, IV! (where M is an integer equal to or greater than 2) digital signals are input via input terminals 

20 100-, to 100 M to the frame forming part 110, wherein they are separated for each frame, for example, every 1024 
samples. These digital si gnals of every M frames are subjected to inter-channel orthogonal transformation in an inter- 
channel orthogonal transform part 190, from which orthogonal-transformed signals are provided. That is ; samples of 
M digital signals at the sa me point in time are orthogonally transformed. When lossless transformation using an integral 
value is applied to the inter-channel orthogonal transformation, it is possible to achieve lossless coding as a whole. 

25 [0207] The orthogonal— transformed signals are input to the rearrangement part 1 60. In the rearrangement part 1 60 
the same bit positions (digits) of respective samples of each frame are arranged in a temporal order for each component 
(for example, L+R and L_ — R) of the orthogonal-transformed signals throughout the frame to form equi-position bit se- 
quences). 

[0208] The equi-position bit sequences from the rearrangement part 1 60 are separated into pieces of transmission 
30 unit or recording unit data in the transmission/recording unit separating part 31 0. These separated piece of transmis- 
sion/recording unit data are, if necessary, subjected to lossless coding in the lossless coding part 150, and in the 
combining part 320 they are added with a header so that during decoding the separated pieces of transmission/re- 
cording unit data can be reconstructed as one frame, and they are provided as packets Pe to the output terminal 1 70. 
Incidentally, the coding in the lossless coding part 150 is the same as the lossless coding in the prior art. In the case 
35 of giving priorities to the packets Pe, they are assigned priorities in descending order of the energy of the component 
of the orthogonal-transfo rmed signal; for example, the packet containing the component L+R is given the highest priority 
and the packets contain i ng the sign bit and the corresponding transmission/recording unit data on the MSB side are 
higher priorities. 

[0209] In the decoder SO, the packets Pe input thereto via the input terminal 200, if containing auxiliary information, 

40 are each separated by the separating part 440 to the auxiliary information, and the transmission/recording unit data 
(containing the sign bit s& quence). The transmission/recording unit data, if lossless-encoded, is provided to the lossless 
decoding part 21 0, wher^ it is lossless-decoded, thereafter being a transmission/recording unit assembling part 410. 
In the transmission/recor-ding unit assembling part 410, the pieces of transmission/recording unit data of one frame 
are assembled from one or more packets based on their packet numbers; they are assembled for each component of 

45 the orthogonal-transforrr^ed signals. The assembled data is provided to the rearrangement part 220, wherein equi- 
position bit sequences are converted to amplitude bit sequences of one frame, that is, sample sequences (waveform) 
of one component of the orthogonal-transformed signals. No description will be given of the operations of the rear- 
rangement parts 1 60 ancJ 220 since they have been described previously in detail with reference to Figs. 4A, 15A and 
15B. In the absence of a packet erasure, the rearrangement part 220 outputs orthogonal-transformed signals exactly 

50 identical with those input to the rearrangement part 1 60 of the coder 1 0. 

[0210] In an inter-chan nel inverse orthogonal transf orm part 290, each component of the input reconstructed orthog- 
onal-transformed signals is subjected to transformation inverse to the orthogonal transformation in the inter-channel 
orthogonal transform pa rt 190, thereby reconstructing the M-channel digital signals. The M-channel digital signals 
reconstructed for each frame are successively outputted for each channel from the frame combining part 250, to output 

55 terminals 260-, to 260 M , respectively. 

[0211] In this way, the> M-channel digital signals can be transmitted or recorded by their inter-channel orthogonal 
transformation. It is poss ible to obtain reconstructed signals of relatively high quality by: packetizing in terms of trans- 
mission/recording unit; increasing priority as the energy becomes larger or as MSB is approached; and using packets 
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of high priority when the channel capacity or storage capacity is small. Further, as described later on, compensation 
tor information lost by a p> acket erasure permits reconstruction of multi-channel digital signals of better quality. 
[0212] In the above, th^ lossless coding part 150 and the lossless decoding part 210 may be omitted. 

5 EMBODIMENT 14 

[0213] When such a transform scheme as DFT or DCT is used for the inter-channel orthogonal transform, the re- 
constructed digital signals differ from the original digital signal even if orthogonal-transformed signals are subjected to 
the inter-channel inverse orthogonal transform. Further, only part of orthogonal transform coefficient, that is, only a 
10 component of large energ ~y, for example, only L+R, may sometimes be required to output as a packet. This embodiment 
is intended to deal with tM*ese problems. 

[0214] Fig. 39 illustrate -« in block form a fourteenth embodiment of the invention. This embodiment differs from the 
Fig. 39 embodiment in th* at all or some components of the orthogonal-transformed signal from the inter-channel or- 
thogonal transform part 1 90 ; that is, components of large power, are subjected to lossless coding in the coding part 

is 120, from which the main code Im is output. The code from the coding part 120 is decoded in a local decoding part 
1 30 to generate a locally reconstructed signal. The locally reconstructed signal for the code Im can be obtained in the 
coding part 120 due to its analysis-by-synthesis coding scheme. In an inter-channel orthogonal inverse transform part 
1 80 the locally reconstructed signal is transformed inversely to that in the inter-channel orthogonal transform part 1 90, 
by which digital locally reconstructed signals of a plurality of channels are produced. Error signals between the locally 

20 reconstructed signals of the respective channels and the digital signals of the corresponding channels, which are 
provided from the frame f arming part 1 1 0, are calculated in the error calculating part 1 40. In a bit sequence converting 
part 50 the calculated err-or signals are subjected to processing of the rearrangement part 160, the transmission/re- 
cording unit separating p &rX 310 and the lossless coding part 150. 

[0215] The main code I m from the coding part 120 is separated by the transmission/recording unit separating part 

25 310 to transmission/reco r~ding unit, and in the combining part 250 the transmission/recording unit and the error code 
Ine from the bit sequence converting part 50 are combined, and the combined output provided as the packet Pe as 
required. Incidentally, th& bit sequence converting part 50 needs only to be provided with at least the rearrangement 
part 1 60 in Fig. 38 and n & eds not to perform the processing of the transmission/recording unit separating part 31 0 and 
the lossless coding part 150. in this case, the main code Im is not subjected to the processing of the transmission/ 

30 recording unit separating part 310. When the main code Im and the error code Ine are output as packets from the 
combining part 320, the hnighest priority level is given to the packet containing the main code Im. 
[0216] In the decoder 2^0, the main code Im and the error code Ine are separated in the separating part 440. The 
main code Im is subjects d to lossless decoding in the decoding part 60, and the reconstructed signals are subjected 
to inter-channel orthogor» al inverse transformation in the inter-channel orthogonal inverse transform part 290 through 

35 the same processing as i n that the inter-channel orthogonal inverse transform part 1 80 of the coder 1 0. 

[0217] On the other ha «nd, the error code Ine is input to the bit sequence inverse conversion part 70, which performs 
the processing of the lossless decoding part 210, the transmission/recording unit assembling part 410 of the decoder 
20 in Fig. 38, reconstruct! ng the error signal sample sequences. In this instance, however, it is sufficient only to perform 
at least the processing in the rearrangement part 220, and it is not always necessary to perform the processing of the 

40 lossless decoding 21 0 ai — id the transmission/recording unit assembling part 41 0 in correspondence to the associated 
operations on the part of the coder 1 0. 

[0218] These reconstructed error signals and the inversely transformed signals from the inter-channel orthogonal 
inverse transform part 2» 0 are added for each channel in the adding part 240 to obtain reconstructed digital signals of 
the respective channels, which are applied to the frame combining part 250. 

45 [0219] Even if part of tl — le components to be orthogonally transformed is omitted to reduce the number of coded bits 
with a view to implemen ting efficient coding, this embodiment permits reconstruction of the original digital signals. 
Further, when no error si <g na ' components are supplied or even if no sufficient information for signal reconstruction is 
available, it is possible t«D obtain reconstructed signals of certain quality by using the inversely transformed signals 
from the inter-channel or — thogonal inverse transform part 290 as digital reconstructed digital signals. Various kinds of 

so processing can be omitte in the bit sequence converting part 50, and the corresponding processing in the bit sequence 
inverse conversion part 170 can also be omitted. Moreover, the coding part 120 is not limited specifically to lossless 
coding but may also be ^adapted for lossy high-compression-ratio coding. In such a case, the decoding part 60 in the 
decoder 20 is also adapt ed for lossy decoding. The high-compression-ratio coding can be done using such methods 
as mentioned previously with reference to the prior art. 

55 

EMBODIMENT 15 

[0220] Fig. 40 illustrate^ s in block form a fifteenth embodiment of the present invention, in which the parts correspond- 
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ing to those in Fig. 39 are- identified by the same reference numerals. The following description will be given of differ- 
ences between the both ^embodiments. 

[0221] In the coder 1 0 , ^signals from the inter-channel orthogonal transform part 1 90, wherein M-channel digital sig- 
nals are subjected to inte^r-channel orthogonal transformation, are encoded in the coding part 120, from which they 

5 are output as the main c=ode Im. The main code Im is locally decoded in the local decoding part 130. The locally 
reconstructed signal for t »ne code Im can be obtained in the coding part 120 due to its analysis-by-synthesis coding 
scheme. In this embodiment the locally reconstructed signal is not subjected to inter-channel orthogonal inverse trans- 
formation. Instead., it is aps»plied to the error calculating part 140, which calculates an error between each of the orthog- 
onal-transformed signals from the inter-channel orthogonal transform part 1 90 and the component of the main code 

10 Im corresponding to eactn transformed signal. The error signal is provided to the bit sequence converting part 50. 
Thereafter, the same progressing as in the coder of the Fig. 39 embodiment is carried out. 

[0222] In the decoder 2: O, the main code Im reconstructed in the decoding part 60 is provided to the adding part 240, 
wherein its main signals and the error signals reconstructed in the bit sequence inverse conversion part 70 are added. 
In the inter-channel ortho ^<|onal inverse transform part 290 these added component signals are inversely transformed 
is corresponding to the in t*— \e inter-channel orthogonal transform part 190, from which reconstructed digital signals of 
respective channels are p=jrovided to the frame combining part 250. 

[0223] In this instance, too, correct reconstruction of the error signals permits faithfully reproduction of the multi- 
channel digital signals. A&- the case with Embodiment 1 4, this embodiment permits enhancement of the coding efficiency 
by encoding in the codinc=j part 120 only a large-power component selected from the inter-channel orthogonal- trans- 
20 formed signals or predetermined therein on average. The coding in the coding part 120 may be either lossy high- 
compression -ratio coding- or lossless coding. 

[0224] The bit sequenc=e converting part 50 in Figs. 39 and 40 may be identical in construction with the lossless 
coding part 1 8 in Fig. 33 , —for instance. The bit sequence inverse conversion part 70 corresponding to the bit sequence 
converting part 50 may b « identical in construction with the lossless decoding part 21 . 
25 [0225] Alternatively, the=3 lossless coding part 18 in Fig. 35A may be used as the bit sequence converting part 50, and 
the lossless decoding pa mri 21 in Fig. 38B may be used as the bit sequence inverse conversion part 70. 

EMBODIMENT 16 

30 [0226] With the above-<=Jescribed coding/decoding method intended for lossless coding by use of a lossy compressed 
code and a lossless cod^s of its error signal, the reconstructed signal of the lossy compressed code may sometimes 
contain a very small erro r according to the environment of a decoder or computer for reconstructing the lossy com- 
pressed code. In such a «case, even if the reconstructed signal for the lossy compressed code and the lossless code 
are combined with the r^s constructed error signal in the decoder, the reconstructed digital signal will not completely 

35 match the original digital signal. 

[0227] This embodime* — it is intended to provide coding and decoding methods, a coder and a decoder which utilize 
lossy compression codincj and lossless coding of its error signal and allow generation of a reconstructed digital signal 
which theoretically comp Metely matches the original digital signal regardless of the use environment of the decoder or 
computer as will be desc? ribed below with reference to Fig. 41 . 

40 [0228] In the coder 1 O a digital signal from the input terminal 100 is separated on a frame-by-frame, for example, 
every 1 024 samples in th e frame forming part 1 1 0, and the digital signal is encoded for each frame in the lossy coding 
part 120, from which it is output as the main Im. The main code Im is reconstructed in the local decoding part 14, from 
which is provided a local I reconstructed signal, which is applied to a varying maximum digit number detecting part 55 
and a truncating part 56. ~~ The locally reconstructed signal for the code Im can be obtained in the lossy coding part 120 

45 due to its anatysis-by-sy ■—rthesis coding scheme. The varying maximum digit number detecting part 55 detects, over 
one frame or one or moi — e sub-frames in the fame, the digit number that assures the accuracy of the reconstructed 
signal of the main code I m : that is, the maximum of the digit number which varies with the decoding accuracy of the 
decoder. 

[0229] For example, in a decoder based on a coding scheme adapted in MPEG-4 audio standard, it is guaranteed 
so independently of its use -environment that each sample value of the reconstructed signal falls within the range of ±1 
relative to a reference r^=constructed signal. Accordingly, taking the local decoding part 14 into account, here is a 
possibility that the amplit «sudes of reconstructed signal by various decoder contains an error of ±2. The amplitude value 
of the locally reconstruct — ed signal in binary number format may sometimes vary up to a high-order digit number due 

to the above-mentioned H error. 

55 [0230] For example, w hen the amplitude of the locally reconstructed signal is 8192 (0010000000000000 in binary 
number), it is considered that the reference decoded value is 8191 (0001111111111111 in binary number). Accordingly, 
in a different decoder, it is=s considered that the amplitude value varies from 81 90 (0001 1 1 1 1 1 1 1 1 1 1 1 0 in binary number) 
to 8194 (00100000000OC3D010 in binary number). In this case, the decoded value is guaranteed only at highest-order 
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two digits even if the use environment is changed. 

[0231] The maximum v^lue of variable digit number herein mentioned refers to the digit number over which the binary 
representation of the ampDlitude of a reconstructed waveform agrees with the waveform of the original signal up to a 
specified digit number in one frame or one or more sub-frames. When the above-said number 81 92 is contained, the 

5 maximum digit number is 14. In the above numerical example, the minimum value of accuracy is highest-order two 
digits. In case of a negat i ve number, the same processing as mentioned above is performed for the absolute value. 
When the reconstructed amplitude is any one of-2, -1 , 0, 1 and 2, it is predetermined that all digits are 0s so as to 
prevent polarity inversion . The varying maximum digit number detecting part 55 calculates the accuracy that is guar- 
anteed for each sample o"t each locally reconstructed signal every frame or one or more sub-frames, that is, calculates 

10 the amplitude value guaranteed to be reconstructed and obtains the minimum value of accuracy that is guaranteed 
every frame or one or mo- re sub-frames, that is, the maximum value of the variable digit number as shown in Fig. 4. 
[0232] The varying maximum digit number detecting part 55 calculates, for each sample of the locally reconstructed 
signal, the digit number ^wariable according to environment as mentioned above, detects the maximum value of the 
variable digit number eve> ry frame of one or more frames, and outputs it as a digit number code Ig, while at the same 

15 time the truncating part 5S truncates the values equal to or smaller than the maximum value of the varying digit number, 
generating an accuracy-g uaranteed locally reconstructed signal. The accuracy-guaranteed locally reconstructed signal 
is such as indicated by tr^» e line 11 defining the lower edge of the hatched portion in Fig. 42. 

[0233] An error signal toetween the accuracy-guaranteed locally reconstructed signal and the digital signal from the 
frame forming part 1 1 0 is calculated in an error calculating part 1 6. The error signal becomes the signal of that portion 
20 of the digital signal from the frame forming part 110 which underlies the accuracy-guaranteed locally reconstructed 
signal line 11 in Fig. 42. The error signal is subjected to lossless coding in a lossless coding part 18, from which it is 
output as the error code Ine. The main code l SJ the error code Ine and the digit number code Ig are combined in the 
combining part 320, whose combined output is provided to the output terminals 170. 

[0234] In the decoder ^ O the input code is separated for each frame by the separating part 440 to the main code Im, 

25 the digit number code Ig and the error code Ine. The main code Im is subjected to lossy decoding in the lossy decoding 
part 60, from which the reconstructed signal is provided. The digit number code Ig is reconstructed in a digit number 
decoding part 81 , from wl — lich the varying maximum digit number is obtained. A truncating part 82 truncates those value 
of the decoded signal frc=>m the lossy decoding part 60 which are equal to or smaller than the value of the varying 
maximum digit number a rid, outputs an accuracy-guaranteed reconstructed signal. 

30 [0235] The error signa I Ine is lossless-reconstructed in the lossless decoding part 21 , by which the error signal is 
reconstructed. The error s ignal and the accuracy-guaranteed reconstructed signal from the tru ncating part 82 are added 
together in the adding part 240, and the added signal is applied as the reconstructed digital signal to thef rame combining 
part 250, which sequenti ^Hy combines the reconstructed signals of the respective frame and provides the combined 
output to the output term ■ nal 260. 

35 [0236] As described afc» ove, the accuracy-guaranteed local signal produced in the coder 1 0 is kept unaffected by the 
worst total value of errore= that occur in the local decoding part 14 and the decoder 20, and the accuracy-guaranteed 
reconstructed signal prod uced in the decoder is theoretically in perfect agreement with the accuracy-guaranteed locally 
reconstructed signal of tr~»e decoder. Accordingly, if the error signal is correctly reconstructed, it is possible to obtain a 
reconstructed digital sigrfc al that is ideally in perfect agreement with the original digital signal. In this embodiment the 

40 digit number code Ig may also be an encoded version of the minimum value of accuracy. 

EMBODIMENT 17 

[0237] The varying ma. zximum digit number, which is detected in the varying maximum digit number detecting part 
45 55, frequently becomes ^sbout 3 or 4 bits when one sample is represented by 16 bits, for instance. With a sample of 
decoding accuracy at on ly high-order two digits as in the afore-mentioned numeric example, the minimum value of 
accuracy, that is the vary fing maximum digit number increases and the amplitude of the error signal increases accord- 
ingly, and the number of bits of the error code Ine from the lossless coding part 18 increases, impairing the coding 
efficiency. However, this occurs in the case where the sample value of the locally reconstructed signal is 1 only at one 
so of high-order digits and O at all the other digits as in the afore-mentioned numeric example-the possibility of occurrence 
of such a phenomenon i 5 remote. That is, excepting such exceptional samples, the minimum value of accuracy is 
about 1 2 or 1 3 bits assh own in Fig. 43A, for instance. 

[0238] This embodime r— it is intended to produce such an accuracy-guaranteed locally reconstructed signal as depict- 
ed in Fig. 43A by encodi r— ag, every frame or one or more sub-frames: the minimum value of accuracy excepting excep- 
ts tional samples, that is, th « variable maximum digit number; information about the positions (in the frame or sub-frame) 
of the exceptional samples; and their accuracy, that is, the varying maximum digit number. 

[0239] For example, a-s shown in Fig. 44 in which the parts corresponding to those in Fig. 41 are identified by the 
same reference numeral in the coder the locally reconstructed signal from the local decoding part 14 is applied to 
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an exception detecting pa rt 57, which detects an exceptionally greatly varying digit number (exceptionally low accuracy) 
and provides the digit number (or accuracy) and the sample position information to the varying maximum digit number 
detecting part 55 and the- truncating part 56, while at the same time encodes the variable digit number (or accuracy) 
and the sample position i information and outputs them as an exception code Ige. 

s [0240] The varying maximum digit number detecting part 55 removes the exceptional samples from the locally re- 
constructed signal, then c£ etects the varying maximum digit number (or accuracy minimum value) of the removed locally 
reconstructed signal, and applies it to the truncating part 56, while at the same time encoding and outputting it as the 
digit number code Ig. Th& truncating part 56 truncates from the locally reconstructed signal, for the exceptional sample, 
the value equal to or sm waller than the numerical value of its varying digit number and for the other portions the value 

10 equal to or smaller than t Rne numerical value of its varying maximum digit number, thereby providing the locally recon- 
structed signal as an accuis racy -guaranteed locally reconstructed signal. The accuracy-guaranteed locally reconstructed 
signal is applied to the ei—ror calculating part 16. The combining part 320 combines the main code Im, the error code 
Ine, the digit number cod «e Ig and the exception code Ige as well and outputs the combined output. This embodiment 
is identical with the Fig. embodiment except the above. 

15 [0241] The exceptional samples are those samples in which is low in the accuracy of the value of only a predetermined 
number of bits (large in th « variable digit number); alternatively, samples are selected in an ascending order of accuracy 
of the values to a predeto^ rmined number of bits (in ascending order of the variable digit number). In the combining part 
320, as shown in Fig. 43^3, for instance, a code indicating the number of exceptional sample, position information the 
exceptional samples and the exception code Ige representing the varying digit number (accuracy) are arranged in this 

20 order for each frame (or s ub-frame) and the digit number code Ig is added to the end of the arrangement, and they are 
output as one block for e- sen frame or sub-frame. 

[0242] In the decoder ^ 0 the separated exception code Ige is decoded in an exception decoding part 83, from which 
sample position informat ■ on and the variable digit number are obtained. The reconstructed signal from the lossy de- 
coding part 60 is appliec* to a truncating part 82, which truncates values of the of sample indicated by the sample 

25 position information from "the exception decoding part 83, which is equal to or smaller than the value equal to or smaller 
than the bit value of the varying maximum digit number of the sample. As for the other samples, the values equal to 
or smaller than the bit va I ues of the variable maximum digit numbers indicated by the exception codes Ige decoded in 
the exception decoding p »rt81 are truncated in the truncating part 82. As a result an accuracy- guaranteed local signal 
is generated. This embodiment is identical with the Fig. 41 embodiment except the above. 

30 [0243] This embodime t — it reduces the amount of information of the error signal in the coder 1 0, and hence enhances 
coding efficiency in the lossless coding part 1 8. 

[0244] The lossless cocding part 1 8 in Figs. 41 and 44 may be of the same construction as that of the lossless coding 
part 18 in Fig. 33, for instance. In this case, the lossless decoding part 21 in the decoder 20 may be of the same 
construction as that of thi e lossless decoding part 21 in Fig. 34. Alternatively, the lossless coding part 18 in Fig. 35A 
35 may be used intact as th & lossless coding part 1 8, in which case the lossless decoding part 21 may use the configuration 
shown in Fig. 35B. 

[0245] The coding and decoding method according to the above-described embodiments of the present invention 
can be implemented by describing computer-executable programs on recording media and, as required, reading and 
executing them on a corr— iputer, 

40 

EFFECT OF THE INVENBTION 

[0246] As described at> ove, according to the coding and decoding methods of the first aspect of the present invention, 
corresponding bits of as equence of samples are successively obtained for each frame to generate equi-position bit 

45 sequences, which are ot-atput in a packet form,. so that even if a packet is erased during transmission, the erasure of 
corresponding bits of the* sample sequence of the decoded frame does not seriously degrades the signal quality. 
[0247] According to th& coding and decoding methods of the second aspect of the present invention, the maximum 
digit number which varie-s based on the accuracy of the decoder used is detected for each frame or sub-frame in 
accordance with the acci iracy of the reconstructed signal guaranteed by the decoder, and the values in a locally re- 

50 constructed signal which are equal to or smaller than the bit value of its varying maximum digit value are truncated, 
by which an accuracy-gu sranteed local signal is provided, and an error signal between the local signal and the original 
digital signal is lossless-encoded. Accordingly : during decoding it is possible to obtain an accuracy-guaranteed recon- 
structed signal which is theoretically in agreement with the accuracy-guaranteed digital signal from the coder, by trun- 
cating from the reconstru ^ted signal of the lossless-code the values equal to or smaller than the bit value of the recon- 

55 structed varying maximum digit number 

[0248] As described atzaove, the present invention can be recognized as the following aspects: 

1st aspect: A coding method for encoding a digital signal for each frame comprising a plurality of samples, com- 
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prising the steps of: 

(a) generating m ultiple sets of data either consisting of multiple sets of lossless data of bits over said samples 
at each one of b it positions of said digital signal in said frame or consisting of lossy data and lossless data of 

5 an error signal d ueto said lossy data; and 

(b) outputting sa id multiple sets of data. 

2nd aspect: The cod i ng method of 1st aspect, wherein said step (a) includes a step of converting an amplitude of 
each of said samples to a binary format consisting of a sign bit and an absolute value prior to said lossless coding. 
10 3rd aspect: The codi rig method of 1st aspect, wherein said step (b) includes a step of forming a packet including 

said lossless code w ith said header information, and outputting said packet. 

4th aspect: The codi ng method of 1st aspect, wherein said step (b) includes a step of assigning priorities to said 

bitstream in a descending order of significance of a sign bit and an absolute value. 

5th aspect: The codi mg method of 1 st aspect, wherein said step (a) includes the step of: 

15 

(a-1) lossy codir*g of an original sound to generate lossy compression information and locally reconstructed 
signal; and 

(a-2) performing said lossless coding of an error signal between said locally reconstructed signal and said 
original signal as said digital signal; and 
20 said step ( fc) outputs said lossy compression information together with said lossless code. 

6th aspect: The codi ng method of 1st aspect, further comprising a step of calculating parameters representing a 
spectral envelope of said digital signal, encoding said parameters and outputting a code for said parameters as 
auxiliary information together with said lossless code. 
25 7th aspect: The codi ng method of 1st aspect, wherein said step (a) comprises the steps of: 

(a-1) determinin <g, as a number of effective digits, a number of digits representing a maximum value of an 
absolute value o f the amplitude of said digital signal in each frame; and 

(a-2) forming at least one bitstream comprising bits of samples of each frame at least every one bit position 
30 within said numtaer of digits in a temporal order in said each frame as a pieces of transmission/recording unit 

data as a part or said lossless code; and 

said step (b) in eludes a step of outputting said number of effective digits together with said lossless code. 
8th aspect: The codi ng method of 7th aspect, wherein said step (b) includes a step of outputting said number of 
35 effective digits as au zxiliary information, or said number of effective digits in any one of packets for said frame. 

9th aspect: The metrnod of 6th aspect, wherein said step (a) is characterized by: 

(a-1 ) calculating linear prediction coefficients as said parameters, and a current predicted value based on the 
preceding digital signal; and 

40 (a-2) subtracting said predicted value from the current sample to obtain a prediction error as said digital signal; 

and 

said step ( b) includes a step of outputting said linear prediction coefficients as auxiliary information to- 
gether with said lossless code. 

45 10th aspect: The coczJing method of 1st aspect, further comprising the steps of: 

(0-1) lossy codimg of an input signal for each frame : with respect to a perceptual characteristics to a lossy 
compressed code and forming a locally reconstructed signal; 

(0-2) generating a modified locally reconstructed signal by modifying said locally reconstructed signal so as 
so to reduce an error between said locally reconstructed signal and said input signal; and 

(0-3) generating an error signal between said input signal and said modified locally reconstructed signal as 
said digital signal. 



55 



11th aspect: The cocding method of 10th aspect, wherein said step (0-2) includes: 

calculating modi-fied parameters including a cross-correlation component between said digital signal and said 
locally reconstru cted signal, and outputting a modified parameter code for said modified parameters; and 
multiplying or co nvoluting said locally reconstructed signal by said modified parameter to generate said mod- 
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ified locally reco nstructed signal. 

12th aspect: The cod ing method of 10th aspect, wherein said step (0-2) includes the steps of: 

multiplying said I ocally reconstructed signal by a modified parameter or combining a plurality of samples with 

modified parameters to generate said modified locally reconstructed signal; and 

generating said r-nodif ied parameter for each frame so that the energy of said error signal is reduced. 

13th aspect: The cod ing method of 10th aspect, wherein said step (0-2) includes the steps of: 

(0-2-1) calculating an error between said locally reconstructed signal and said digital signal to generate an 
error signal; 

(0-2-2) encoding said error signal, which minimizes a quantization error to an error minimized code, and gen- 
erating a second locally reconstructed signal for said error minimized code; and 

(0-2-3) adding s^id second locally reconstructed signal and said locally reconstructed signal to obtain said 
modified local signal. 

14th aspect: The cod ing method of 10th aspect, wherein said step (0-2) includes the steps of: 

(0-2-1 ) encoding said digital signal, which minimizes a quantization error to an error minimized code to obtain 
a second locally reconstructed signal for said error minimized code; and 

(0-2-2) obtaining a linear combination of said locally reconstructed signal and said second locally reconstructed 
signal with large r coefficients for said locally reconstructed signal to calculate said modified local signal. 

15th aspect: The coding method of 1st aspect further comprising the steps of: 

(0-1) lossy codin g of an input signal for each frame, with respect to a perceptual characteristics, and a first 
lossy compress e>d code; 

(0-2) lossy cod in g of said digital signal to a second lossy compressed code and a local signal for said second 
lossy compress es-d code; and 

(0-3) generating , as said digital signal, an error signal between said local signal and said digital signal. 

1 6th aspect: The coding method of 1 st aspect, further comprising the steps of: 

(0-1 ) performing lossy compression coding of an input signal for each frame to minimize a quantization error, 
and outputting an error minimized code and generating for said error minimized code a first locally reconstruct- 
ed signal; 

(0-2) generating , as said digital signal, an error signal between said first local signal and said input signal: and 
(0-3) performing lossy coding of said error signal, with respect to a perceptual characteristics, and outputting 
a lossy compres -sed code. 

17th aspect: The coding method of 1st aspect, further comprising the steps of: 

(0-1) mixing M-c Kiannel input signals into N-channel signals, said M being an integer equal to or greater than 
2 and said N bei ng an integer equal to or than 1 and equal to or smaller than said M; 

(0-2) encoding s -aid N-channel signals to generate a main code and N-channel locally reconstructed signals 
for said main code; 

(0-3) transforming said N-channel locally reconstructed signals into M-channel locally reconstructed signals; 
and 

(0-4) obtaining, -as said digital signal, error signals between each of said M-channel locally reconstructed 
signals and corresponding one of said M-channel input signals; and 

said step ( fa) is a step of outputting said main code together with said lossless code. 

18th aspect: The coding method of 16th aspect, further comprising the steps of: 

(0-1) mixing said N-channel mixed signals into L-channel mixed signals, said L being an integer equal to or 
greater than 1 a r~id equal to or smaller than said N; 

(0-2) encoding &aid L-channel mixed signals to generate said main code and said L-channel locally recon- 
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structed signals "l = or said main code; 

(0-3) said L-chananel locally reconstructed signals into N-channel locally reconstructed signals; 

(0-4) calculating ^=rrors between said N-channel locally reconstructed signals and said N-channel mixed signals 

as first error sig n als; 

(0-5) encoding s^^id first error signals to generate a sub-code and N-channel locally reconstructed error signals 
for said sub-cod ers ; 

(0-6) adding saicM N-channel locally reconstructed signals and said N-channel locally reconstructed error sig- 
nals to generate N-channel added locally reconstructed signals; 

(0-7) transformin — s said N-channel added locally reconstructed signals into said M-channel locally reconstruct- 
ed signal; and 

(0-8) generating = as said digital signal, second error signals between each of said M-channel locally recon- 
structed signals ^nd corresponding one of said M-channel digital signals: 

said step ( * > ) includes a step of outputting said main code and said sub-code together with said lossless 

code and said m *=^iin code. 

1 9th aspect: The cod ing method of 1 st aspect, further comprising a step of inter-channel orthogonal transforming 
M-channel input sign .als into orthogonal transform signals as said digital signal, said M being an integer equal to 
or greater than 2, anczj said steps (a) and (b) being performed for each of said M channels. 
20th aspect: The cod! ing method of 1st aspect, further comprising the steps of: 

(0-1)inter-chann «el orthogonal transforming M-channel input signals into orthogonal transform signals, M being 
an integer equal to or greater than 2; 

(0-2) encoding a t least one part of said orthogonal transform signals to generate a main code and locally 

reconstructed si ? i naig for said main code; 

(0-3) inter-chan el inverse orthogonal transforming said locally reconstructed signals to M-channel locally 
reconstructed si c=m als; and 

(0-4) producing, as said digital signal to be lossless coded, an error signal between each of said M-channel 
locally reconstnj«=5ted signals and corresponding one of said M-channel digital signals; 

said step ( i > ) includes a step of outputting said main code together with said lossless code. 

21st aspect: The coci ing method of 1st aspect, further comprising the steps of: 

(0-1) inter-chanm el orthogonal transforming M-channel input signals to orthogonal transform signals, M being 
an integer equal to or greater than 2; 

(0-2) encoding a^t least one part of said orthogonal transform signals to generate a main code and locally 
reconstructed si ? | n»is for said main code; and 

(0-3) producing, as said digital signal to be lossless coded, an error signal between each of said locally re- 
constructed sign —als and corresponding one of said orthogonal transform signals; and 

said step » ) includes a step of outputting said main code together with said lossless code. 

22nd aspect: The co*=iing method of 1st aspect wherein said step (a) comprises the steps of: 

(a-1 ) generating lossy code and producing a locally reconstructed signal by lossy coding of said digital signal; 
(a-2) obtaining a. maximum digit code for a maximum number of variable digits for each frame or subframe 
from said locally reconstructed signal; 

(a-3) generating sen accuracy-guaranteed signal by omitting or rounding components equal to or less than said 
maximum numb^^r of variable digits from said locally reconstructed signal; 

(a-4) generating ^=i n error signal between said accuracy-guaranteed locally reconstructed signal and said digital 
signal; and 

(a-5) lossless co <-^Jing said error signal to said lossless code. 

23rd aspect: A deco «ding method which reconstructs a sequence of samples of a digital signal for each frame, 
comprising the steps of: 

(a) decoding inp i it codes to produce multiple sets of data either consisting of multiple sets of lossless data of 

bits over said sa mples at each one of bit positions of said digital signal in said frame or consisting of lossy 
data and lossles-^s data of an error signal due to the lossy data; and 

(b) reconstructs <cj a digital signal based on said multiple sets of data. 
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24th aspect: The dec oding method of 23rd aspect, wherein said step (b) includes a step of converting said sample 
sequences from a b i r—jary format consisting of a sign bit and an absolute value to a 2's complement format. 
25th aspect: The deo oding method of 23rd aspect . wherein said step (b) includes a step of correcting said digital 
signal by smoothing said digital signal. 
5 26th aspect: The decoding method of 23rd aspect, wherein said step (b) includes a step of reconstructing the 

spectral envelope by cdecoding an auxiliary information, and correcting said digital signal so that a spectral envelope 
of said digital signal approximates said reconstructed spectral envelope. 
27th aspect: The de& oding method of 26th aspect, wherein said step (b) includes the steps of: 

10 (b-1) substituting* a provisional samples for missing or error bits; 

(b-2) calculating a spectral envelope of said provisional samples; 

(b-3) normalizing^ the spectral envelope of said provisional samples by characteristics of said reconstructed 
spectral envelop «s or its modified spectral envelope; and 

(b-4) producing i-estored samples by using said reconstructed spectral envelope or said modified spectral 
15 envelope and sa id flattened spectral envelope. 

28th aspect: The de&oding method of 26th aspect:, wherein said step (b) includes the steps of: 

(b-1 ) substituting a provisional samples for missing or error bits; 
20 (b-2) calculating a spectral envelope of said provisional samples; 

(b-3) calculating one spectral envelope by normalizing said spectral envelope by said reconstructed spectral 
envelope or its n — lodified spectral envelope; and 

(b-4) restoring said provisional samples by use of said one spectral envelope. 

25 29th aspect: The de<=oding method of 27th aspect, wherein said step (b-3) includes steps of converting said cal- 

culated spectral envelope to linear prediction cepstrum coefficients Ca. converting said reconstructed spectral 
envelope to a linear p> rediction cepstrum coefficients Cb or using reconstructed spectral envelope for said auxiliary 
information, and calo elating differences Cb-Ca between said linear prediction cepstrum coefficients Ca and Cb to 
obtain said one speomral envelope. 

30 30th aspect: The dec=oding method of any one of 27th, 28th and 29th aspects., further comprising the step of: 

(b-5) checking w~ hether a distortion between the spectral envelope of said provisional samples and said re- 
constructed spec^tral envelope is within a predetermined value; 
setting said provisional samples as restored samples; and 
35 if not within said predetermined value, repeating said steps (b-2), (b-3) and (b-4). 

31st aspect: The decoding method of 23rd aspect, wherein said step (a) includes a step of lossy-decoding lossy 
codes to locally reco r— istructed signal, adding said locally reconstructed signal and said digital signal. 
32nd aspect: The de>«coding method of 23rd aspect, wherein said step (a) includes a step of decoding a piece of 
40 transmission/record ing unit data of said lossless code to at least one reconstructed bitstream at least one bit 

position in said one f vame based on said header information; and 

said step (b) includes a step of detecting an erasure or an error for said transmission/recording unit data and 
a step of adjusting digits of said samples of said one frame in accordance with an input number of effective digits. 
33rd aspect: The dec^oding method of 32nd aspect, wherein said step (b) includes a step; 

45 

if the number of effective digits for a current frame is larger than the number of effective digits for the one of 
preceding frames, downward shifting the samples in the preceding frames so that the number of effective 
digits for the preceding frame equals to the number of effective digits for the current frame, and 
if the number of effective digits for a current frame is smaller than the number of effective digits for the one of 
so preceding frames, upward shifting the samples in the preceding frame so that the number of effective digits 

for preceding fraw-ne equals to the number of effective digits for the current frame. 

34th aspect: The deciding method of 23rd aspect, wherein said samples are those of a prediction error signal, 
said method includin s * ne steps of: 

55 

(c) correcting thes prediction error signal for an error or a missing unit data based on the spectral envelope of 
the prediction err~or signal; 

(d) decoding inp i it auxiliary information to linear prediction coefficients; and 
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(e) synthesizing, based on linear prediction, a reconstructed original signal from said prediction error signal 
and preceding samples of said reconstructed original signal. 

35th aspect: The decoding method of 34th aspect, wherein said step (c) includes the steps of: 

(c-1) substituting provisional samples for missing or error bits; 
(c-2) calculating -a spectral envelope of said provisional samples; 

(c-3) calculating a flatness of said spectral envelope, and if said flatness is within a predetermined value, 
setting said provisional samples as said prediction error signal; 

(c-4) if said flatn ess is not within said predetermined value, normalizing said provisional samples by said 
spectral envelope or its modified spectral envelope waveform to obtain a normalized signal; and 
(c-5) repeating ssid steps (c-1) to (c-4) using said normalized signal as said provisional samples. 

36th aspect: The decoding method of 34th aspect, wherein said step (c) includes the steps of: 

(c-1 ) substitutin g provisional samples for missing or error bits; 

(c-2) filtering saiczi provisional samples by use of said reconstructed linear prediction coefficients to generate 
a synthesized signal; 

(c-3) calculating spectral envelope of said synthesized signal; 

(c-4) normalizing said provisional error signal by use of said spectral envelope or its modified spectral envelope 
to obtain a spect rum flattened signal; and 

(c-5) filtering saicd spectrum flattened signal by use of said reconstructed linear prediction coefficients to re- 
construct a predi otion error waveform. 

37th aspect: The dec^oding method of 34th aspect, wherein said step (c) includes the steps of: 

(c-1) substituting, provisional samples for missing or error bits; 

(c-2) filtering saicd provisional samples by use of said reconstructed linear prediction coefficients to generate 
a synthesized signal; 

(c-3) calculating linear prediction coefficients of said synthesized signal; 

(c-4) calculating linear prediction coefficients being a combination of an inverse characteristics of said calcu- 
lated linear prediction coefficients or their band-enlarged linear prediction coefficients, and said reconstructed 
linear prediction coefficients or their band-enlarged linear prediction coefficients; and 

(c-5) filtering saicd provisional samples by use of said combined linear prediction coefficients to produce the 
prediction error signal. 

38th aspect: The deciding method of 36th or 37th aspect, further comprising the step of: 

(f) checking whether a distortion between said calculated linear prediction coefficients and said reconstructed 
linear prediction coefficients is within a predetermined value; 

if within said predetermined value, setting the provisional samples as restored prediction error signal; and 
if not within said predetermined value, repeating said steps (c-2) to (c-5) applying to said synthesized signal 
as said provisior* al samples. 

39th aspect: The de<=oding method of 31st aspect, further comprising the steps of: 

(c) modifying sai «i locally reconstructed signal by reducing an error between said locally reconstructed signal 
and said digital signal, thereby generating a modified signal; and 

(d) combining sa id modified decoded signal and said error signal to renew said reconstructed signal. 
40th aspect: The deczroding method of 39th aspect, wherein said step (c) comprises the steps of: 

(c-1) decoding a modified parameter code to a modified parameter; and 

(c-2) multiplying or convoluting said locally reconstructed signal by said modified parameter to obtain said 
modified signal. 

41st aspect: The dec=oding method of 39th aspect, wherein said step (c) comprises the steps of: 
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(c-1) multiplying or convolving said locally reconstructed signal by a modified parameter with at least one 
modified parameter to generate said modified signal; and 

(c-2) generating «aid modified parameter so that the energy of an error signal between said modified signal 
and said reconstructed signal reduces. 

5 

42nd aspect: The decoding method of 23rd aspect, further comprising the steps of: 

(c) lossy decodirfc g an error minimized code to reconstruct a first locally reconstructed signal; 

(d) adding said d igital signal and said first locally reconstructed signal to reconstruct a first digital signal; 

10 (e) lossy decoding with respect to a perceptual characteristics a second lossy code to reconstruct a second 

locally reconstructed signal; and 

(f) outputting saiczd first digital signal or said second digital signal. 
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43rd aspect: The dec=oding method of 39th aspect, wherein said step (c) includes the steps of: 
(c-1) decoding a r~i error minimized code to a second locally reconstructed signal; and 

(c-2) adding said ^second locally reconstructed signal to said locally reconstructed signal to said modified signal. 

44th aspect: The dec^oding method of 39th aspect, wherein said step (c) includes the steps of: 

(c-1) decoding a m error minimized code to obtain a second locally reconstructed signal; and 
(c-2) weighted aweraging of said second locally reconstructed signal and said locally reconstructed signal with 
a larger weightin coefficient for said second locally reconstructed signal than a weighting coefficient for said 
locally reconstructed signal. 

45th aspect: The dec oding method of 23rd aspect, wherein said samples are M-channel error signals, said M being 
an integer equal to o -w greater than 2, said decoding method further comprising the steps of: 

(c) decoding an i m iput main code to N-channel reconstructed signals, said N being an integer equal to or smaller 
30 than said M and equal to or greater than 1 : 

(d) transforming ^said N-channel reconstructed signals into M-channel reconstructed signals; and 

(e) adding said N^/l -channel error signals and said M-channel reconstructed signals to reconstruct M-channel 
digital signals. 

35 46th aspect: The dec coding method of 23rd aspect, wherein said samples are M-channel error signals, said M being 

an integer equal to o r greater than 2, said decoding method further comprising the steps of: 

(c) decoding an i anput main code to L-channel reconstructed signals, said L being an integer equal to or greater 
than 1 ; 

40 (d) transforming ^aid L-channe! reconstructed signals into N-channel reconstructed main signals, said N being 

an integer equal or larger than said L and equal to or smaller than said M; 

(e) decoding a s ^Jb-code to N-channel reconstructed sub-signal; 

(f) adding said N — channel reconstructed main signal and said N-channel reconstructed sub-signals to generate 
N-channel addeczi signals; 

45 (g) transforming said N-channel added decoded signals to M-channel added signals; and 

(h) adding said PM-channel error signals and said M-channel added signals to reconstruct M-channel digital 
signals. 

47th aspect: The dec oding method of 23rd aspect, wherein said samples are multi-channel samples, said decoding 
so method further com pa* rising the step of: 

(c) inter-channel orthogonal inverse transforming said multi-channel samples to multi-channel digital signals. 

48th aspect: The dec oding method of 23rd aspect, wherein said samples are M-channel error signals, said M being 
55 an integer equal to o r greater than 2, said decoding method further comprising the steps of: 

(c) decoding an input main code to locally reconstructed signals; 

(d) inter-channel orthogonal inverse transforming said locally reconstructed signals to M-channel reconstruct- 
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ed signals; and 

(e) adding said N^-^l-channel reconstructed signals and said M-channel error signals to reconstruct M-channel 
digital signals. 

49th aspect: The decc=>ding method of 23rd aspect, wherein said samples are M-channel error signals, said M being 
an integer equal to o t greater than 2, said decoding method further comprising the steps of: 

(c) decoding an i ssnput main code to obtain M-channel. locally reconstructed signals; 

(d) adding said IV—^l-channel locally reconstructed signals and said M-channel error signals to reconstruct M- 
channel added s fii gnals; and 

(e) inter-channel -orthogonal inverse transforming said M-channel added signals to reconstruct M-channel dig- 
ital signals. 

50th aspect: The dec^- oding method of 23rd aspect, further comprising the steps of: 

(c) decoding a lo ^=^sy code to produce a locally reconstructed signal; 

(d) decoding a rrm aximum digit code to obtain a maximum number of variable digits; 

(e) generating at 1 accuracy-guaranteed signal by omitting or rounding components for equal to or less than 

said maximum n « imber of variable digits from said locally reconstructed signal; and 

(f) reconstructs gpan a reconstructed signal by adding said digital signal and said accuracy-guaranteed signal. 

51 st aspect: The dec<=>ding method of 50th aspect, wherein said step (d) includes a step of decoding an exceptional 
code to exceptional v — alues and their sample positions allocating said exceptional values of their sample positions 
of said accuracy-gusL sa*anteed signal. 

52nd aspect: A code w for coding a digital signal for each frame, comprising: 

means for gener^^ating multiple sets of data either consisting of multiple sets of lossless data of bits over said 
samples at each one of bit positions of said digital signal in said frame or consisting of lossy data and lossless 
data of an error s ignal due to said lossy; and 

output means fot outputting said multiple sets of data to produce codes. 

53rd aspect: The co c k er of 52nd aspect, further comprising: 

a sign bit/absolu te value converting part for converting an amplitude of each of samples to a binary format 

consisting of a si - j p bit and an absolute value, and for providing said converted sample to said lossless coding 
means. 

54th aspect: The co c J er of 53rd aspect, wherein said output means assigns priorities to said bitstream in a de- 
scending order of sig*s== nificance of a sign bit and an absolute value. 
55th aspect: The cocJBier of 52nd or 53rd aspect, further comprising: 

a lossy coder for lossy-coding an original signal to produce lossy compression information and locally recon- 
structed signal; r_ ind 

an error calculat fifing means for producing an error signal between said locally reconstructed signal and said 
original signal as said digital signal; 

wherein said oi itput means outputs said lossy code together with said lossless code. 

56th aspect: The co c: t <ar of 52nd, 53rd or 54th aspect, further comprising an auxiliary information generating part 
for encoding parame~«aers representing a spectral envelope of said digital signal, for encoding said parameters and 
for outputting a code for said parameter as auxiliary information together with said lossless code. 
57th aspect: The cod - — er of 52nd aspect, which further comprises auxiliary information generating part for obtaining 
and outputting, as an effective digit number, a number of digits representing a maximum value of an absolute value 
of the amplitude of s . - i id digital signal of each frame, and wherein said lossless coding means generates, for said 
each frame, said los^^sless code corresponding to the bitstream within said effective digits. 
58th aspect: The cocsler of 52nd aspect, further comprising: 

a spectral envel<=>pe calculating part for calculating linear prediction coefficients representing a spectral enve- 
lope of an input * ; ignal for each frame; 
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an auxiliary info rr nation generating part for encoding said linear prediction coefficients as auxiliary information; 

a predicting part for calculating, for each frame, an integral prediction value of the current input signal from 
the digital signal and linear prediction coefficients of the preceding frame; and 

a prediction erro ^mr generating part for subtracting said predicted value from the current input digital signal to 
obtain, as said d SSgital signal to be lossless coded, a prediction error signal. 

59th aspect: The cod — er of 58th aspect, which further comprises an effective digit number detecting part for obtain- 
ing, as a number of ©-■■tective digits, a digit number representing a maximum value of absolute values of said digital 
siganl and adjoining a=; aid number of effective digits to said auxiliary information, and wherein said lossless coding 
means generates, fo ar each frame, said lossless code corresponding to the bitstream within said effective digits. 
60th aspect: The cocfler of 52nd aspect, further comprising: 

a lossy coding p » rt for lossy coding of an input signal for each frame, with respect to a perceptual characteristics 
to a lossy compr cssed code and forming a locally reconstructed signal; 

a modifying part .^s upplied with said locally reconstructed signal, for modifying said locally reconstructed signal 

so as to reduce * » n error between said locally reconstructed signal and said input signal; and 

an error calculat ing part supplied with said input signal and said modified locally reconstructed signal, for 

generating an er ror signal between said input signal and said modified locally reconstructed signal as said 

digital signal. 

61st aspect: The cod- - er of 52nd aspect, further comprising: 

a channel mixir v m part supplied with M-channel input signals, for mixing said M-channel input signals into N- 

channel signals , said N being an integer equal to or larger than 1 and equal to or smaller than said M, and M 
being an integer equal to or greater than 2; 

coding part, sup|=r>lied with said N-channel mixed signals, for encoding said N-channel signals to generating a 
main code, and I M-channel locally reconstructed signals for said main code; 

a channel expan —cling part supplied with sard N-channel locally reconstructed signals, for transforming said N- 
channel locally n Tinrtrrl signals into M-channel locally reconstructed signals; 

an error calculatz= ing part for producing, as said digital signaL error signals between said M-channel locally 
reconstructed si c j nals and said M-channel input signals; and 

wherein said oi itput means outputs said main code together with said lossless code. 

62nd aspect: The co ^^der of 52nd aspect, further comprising: 

an inter-channel orthogonal transform part for transforming M-channel input signals into orthogonal transform 
signals, M being an integer equal to or greater than 2; 

coding part for c^=oding at least one part of said orthogonal transform signals to generate a main code and 
locally reconstru c ted signals; 

an inter-channel orthogonal inverse transform part for transforming said locally reconstructed signals, to M- 
channel locally r«sssconstructed signals; and 

an error calculat ^ang part for producing an error signal between each of said M-channel locally reconstructed 
signals and corr^^^sponding one of said M-channel input signals each as said digital signal to be lossless coded; 
and 

wherein said oi itput means outputs said main code together with said lossless codes. 

63rd aspect: The coczzzter of 52nd aspect, further comprising: 

an inter-channel orthogonal transform part for transforming M-channel input signals into orthogonal transform 
signals, M being an integer equal to or greater than 2; 

coding part for <z^=oding at least one part of said orthogonal transform signals, to generate a main code and 
locally reconstru <— ^ted signals; and 

an error calculat Bng part for producing an error signal between each of said locally reconstructed signals and 
corresponding o arame of said orthogonal transform signals each as said digital signal to be lossless coded; and 

wherein said om itput means outputs said main code together with said lossless code. 

64th aspect: The co r l er of 52nd aspect, further comprising: 
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a lossy coding p^rt for lossy coding an input signal to produce a lossy code; 
a local reconstru oting part for producing, from said lossy code, a locally reconstructed signal; 
a maximum variable digits number detecting part for detecting from said locally reconstructed signal a maxi- 
mum number of x^-ariable digits for each frame or one or more sub-frames and producing a maximum digit code 
representing saicd maximum number of variable digits; 

a truncating part for truncating or rounding components equal to or smaller than said maximum number of 
variable digits fro- m said locally reconstructed signal to generate an accuracy-guaranteed locally reconstructed 
signal; 

an error calculate ng part for generating, as said digital signal to be lossless coded, an error signal between 
said accuracy-guaranteed locally reconstructed signal and said input signal; and 

wherein said o ^utput means outputs said maximum number code and said lossy code together with said 
lossless code. 

65th aspect: A decoder which reconstructs a sequence of samples of a digital signal for each frame, comprising: 

means for decocl ing input codes to produce multiple sets of data either consisting of multiple sets of lossless 
data of bits over said samples at each one of bit positions of said digital signal in said frame or consisting of 
lossy data and lossless data of an error signal due to the lossy data; and 
means for recon structing a digital signal based on said multiple sets of data. 

66th aspect: The de&oder of 65th aspect, further comprising: 

a 2's complement converting part for converting each of said samples from a binary format consisting of a 
sign bit and an absolute value to 2's complement format to provide said samples. 

67th aspect: The dec^oder of 65th or 66th aspect, further including: 

a missing inform stion compensating part for estimating missing bitstreams from known information, and cor- 
recting said sam §ole sequences. 

68th aspect: The deczroder of 67th aspect, wherein said missing information compensating part comprises a low- 
pass filter for smooth* ing said sample sequences input thereto. 

69th aspect: The de<czroder of 67th aspect, which further comprises an auxiliary information decoding part for de- 
coding auxiliary information input thereto to obtain a spectral envelope; and 

wherein said nr* issing information compensating part corrects said sample sequences so that their spectral 
envelope approaches said decoded spectral envelope. 

70th aspect: The de<=oder of 69th aspect, wherein said missing information compensating part comprises: 

a provisional samples generating part for substituting provisional samples for missing or error bits over sam- 
ples; 

a spectral envelc=>pe calculating part for calculating a spectral envelope of said provisional samples: 

an inverse filter -for normalizing the spectra! envelope of said provisional samples by characteristics of said 

reconstructed sp>- ectral envelope or its modified spectral envelope; 

a synthesis filter "for producing a restored samples by using said reconstructed spectral envelope or said mod- 
ified spectral env^elope and said flattened spectral envelope. 

71st aspect: The dect oder of 69th aspect, wherein said missing information compensating part comprises: 

a provisional wa^weform generating part for substituting provisional samples for missing or error bits; 

a spectral envel crape calculating part for calculating the spectral envelope of said provisional samples; 

a composite spe>-<;tral envelope calculating part for calculating linear prediction coefficients of a combination 

of inverse characteristics of said calculated spectral envelope or its modified spectral envelope and coefficients 

of reconstructed spectral envelope or its modified one; 

a synthesis filter for reconstructing said provisional samples by use of said composite spectral envelope. 
72nd aspect: The decoder of 71st aspect, wherein said composite spectral envelope calculating part comprises: 
a first coefficient converting part for converting said calculated spectral envelope to linear prediction cepstrum 
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coefficients Ca; 

a second coeffio lent converting part for converting said reconstructed spectral envelope to linear prediction 
cepstrum coeff Ic i ents Cb or using reconstructed envelope for said auxiliary information; 
a subtracting part for calculating differences Cb-Ca between said linear prediction cepstrum coefficients Ca 
5 and Cb; and 

an inverse conversion part for inversely converting said difference Cb-Ca to obtain said linear prediction co- 
efficients of com joosite spectral envelope. 

73rd aspect: The decoder of 70th or 71st aspect, further comprising an error calculating part for: 

10 

calculating a distortion difference between the spectral envelope of said provisional samples or restored sam- 
ples and said recon structed spectral envelope, setting said provisional samples as restored samples; and 
if not within said predetermined value, supplying said provisional or restored samples to said inverse filter or 
said synthesis f il ~ter. 

15 

74th aspect: The decoder of 65th aspect, further comprising: 

a lossy decoding part for lossy decoding lossy-codes to locally reconstructed signal; and 
adding part for adding said locally reconstructed signal to said digital signal. 

20 

75th aspect: The decoder of 65th aspect, further comprising: an auxiliary information decoding part for decoding 
input auxiliary inform .ation to obtain an effective digit for each frame; and a digit adjusting part for adjusting digits 
of said samples of said one frame or said restored samples in accordance with the number of effective digits. 
76th aspect: The decoder of 75th aspect, wherein said auxiliary information decoding part is to decode average 
25 power as well, and s. aid missing information compensating part is to correct the amplitudes of said samples se- 

quences as well by im se of said decoded average power. 

77th aspect: The decoder of 65th aspect, wherein linear prediction of said samples are those of a prediction error 
signal, said decoder "further comprises: 

30 an auxiliary inforwnation decoding part for decoding input auxiliary information to linear prediction coefficients; 

a combining part for synthesizing reconstructed original signal from said prediction error signal and preceding 
samples of recoi — istructed original signal by use of said linear prediction coefficients: and 
a missing inform ation compensating part for correcting the prediction error signal for an error or missing unit 
data based on tr— le spectral envelope of the prediction error signal. 

35 

78th aspect: The decoder of 77th aspect, wherein said missing information compensating part comprises: 

a provisional waveform generating part for substituting a provisional samples missing or error bits; 
a spectral envelope calculating part for calculating the spectral envelope of said provisional samples; 
40 a flatness decidi ng part for calculating a flatness of said spectral envelope, and if said flatness is within a 

predetermined v -alue, setting said provisional samples as said prediction error signal; and 
an inverse filter f or normalizing said provisional samples by said spectral envelope or modified spectral enve- 
lope waveform to obtain a normalized signals if said flatness is not within said predetermined value. 

45 79th aspect: The decoder of 77th aspect, wherein said missing information compensating part comprises: 

a provisional wa^/eform generating part for substituting provisional samples for missing or error bits; 
a first synthesis -ffilter for filtering said provisional samples by use of said reconstructed linear prediction coef- 
ficients to generate a synthesized signal; 
so a spectral envelope calculating part for calculating a spectral envelope of said synthesized signal; 

a synthetic spect ral envelope calculating part for calculating linear prediction coefficients being is a combination 
of inverse characteristics of said calculated linear prediction coefficients or their band-enlarged linear prediction 
coefficients and said reconstructed linear prediction coefficients or their band-enlarged linear prediction coef- 
ficients; and 

55 a second synthe sis filter for filtering said provisional samples by use of said combined linear prediction coef- 

ficients to produce the prediction error signal. 

80th aspect: The decoder of 74th aspect, which further comprises: 
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a modifying part -for modifying said locally reconstructed signal by reducing an error between said locally re- 
constructed sign and said digital signal, thereby generating a modified signal; and 

an adding part for combining said modified signal and said error signal to renew said reconstructed signal. 

s 81 st aspect: The dec: oder of 65th aspect, wherein said rearrangement part reconstructs M-channel error signals, 

said M being an integer equal to or greater than 2, said decoder further comprising: 

a decoding part "Tor decoding a main code to N-channel reconstructed signals, said N being an integer equal 
to or greater than 1 and equal to or smaller than said M; 
10 a channel expan slon part for transforming said N-channel reconstructed signals into M-channel reconstructed 

signals; 

a erasure detecti ng part for detecting erasure bit and outputting an erasure signal, said information correcting 
part having a missing information compensating part for adding missing information to the waveform of said 
error signal corresponding to the erasure bit detected by said erasure detecting part; and 
15 an adding part for adding said M-channel error signals or corrected error signals and said M-channel recon- 

structed signals to generate M-channel digital signals. 

82nd aspect: The de coder of 65th aspect, wherein M rearrangement parts are provided in correspondence to M 
channels, for outputt i ng M-channel error signals, said M being an integer equal to or greater than 2, said decoder 
20 further comprising: 

a decoding part -f=or decoding a main code to locally reconstructed signals; 

an inter-channel orthogonal inverse transform part for inter-channel orthogonal inverse transforming said lo- 
cally reconstruct ed signals to M-channel reconstructed signals; and 
25 an adding part f o r adding said M-channel reconstructed signals and said M-channel error signals to reconstruct 

M-channel digits I signals. 

83rd aspect: The decoder of 65th aspect, wherein M rearrangement parts are provided in correspondence to M 
channels, for outputt i ng M-channel error signals, said M being an integer equal to or greater than 2, said decoder 
30 further comprising: 

a decoding part -tfor decoding a main code to M-channel locally reconstructed signals; 

an adding part for adding said M-channel locally reconstructed signals and said M-channel error signals to 
reconstruct M-cr^annel added signal; and 
35 an inter-channel orthogonal inverse transform part for inter-channel orthogonal inverse transforming said M- 

channel added ignals to reconstruct M-channel digital signals. 

84th aspect: The decoder of 65th aspect, further comprising: 

40 a lossy decoding part for decoding lossy code to produce a locally reconstructed signal; 

a digit number decoding part for decoding a maximum digit code to obtain a maximum number of variable digits; 
a truncating part for truncating components equal to or smaller than said maximum number of variable digits 
from said locally reconstructed signal to generate an accuracy-guaranteed signal: and 
an adding part for adding together said digital signal and said accuracy-guaranteed signal to obtain a recon- 

45 structed signal. 

85th aspect: A codin <j program for implementing said coding methods of 1st to 22nd aspects on a computer. 
86th aspect: A decocrJing program for implementing said coding methods of 23rd to 51st aspects on a computer. 



50 

Claims 

1. A coding method for- encoding a digital signal for each frame comprising a plurality of samples, comprising the 
steps of: 

55 

(a) generating rr* ultiple sets of data either consisting of multiple sets of lossless data of bits over said samples 
at each one of b It positions of said digital signal in said frame or consisting of lossy data and lossless data of 
an error signal d ue to said lossy data; and 
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r (b) outputting sa i d multiple sets of data. 

2. The coding method of claim 1, wherein said step (b) includes a step of assigning priorities to said bitstream in a 
descending order of significance of a sign bit and an absolute value. 

5 

3. The coding method »f claim 1 , wherein said step (a) includes the step of: 

(a-1) lossy codin cj of an original sound to generate lossy compression information and locally reconstructed 
signal; and 

w (a-2) performing said lossless coding of an error signal between said locally reconstructed signal and said 

original signal a& said digital signal; and 

said step (b) OL-«tputs said lossy compression information together with said lossless code. 

is 4. The coding method o-T claim 1 , further comprising a step of calculating parameters representing a spectral envelope 
of said digital signal , encoding said parameters and outputting a code for said parameters as auxiliary information 
together with said lo^ssless code. 



20 



5. The coding method c^f claim 1 , wherein said step (a) comprises the steps of: 



(a-1) determining, as a number of effective digits, a number of digits representing a maximum value of an 
absolute value oW the amplitude of said digital signal in each frame; and 

(a-2) forming at I -east one bit stream comprising bits of samples of each frame at least every one bit position 
within said numb er of digits in a temporal order in said each frame as a pieces of transmission/recording unit 
25 data as a part of said lossless code; and 

said step (b) in dudes a step of outputting said number of effective digits together with said lossless code. 

6. The method of claim 4, wherein said step (a) is characterized by: 

30 

(a-1 ) calculating linear prediction coefficients as said parameters, and a current predicted value based on the 
preceding digital signal; and 

(a-2) subtractin g said predicted value from the current sample to obtain a prediction error as said digital signal; 
and 

35 

said step (b) includes a step of outputting said linear prediction coefficients as auxiliary information together 
with said lossless co <=ie. 

7. The coding method cs»f claim 1 , further comprising the steps of: 

40 

(0-1) lossy codir-ii g of an input signal for each frame, with respect to a perceptual characteristics to a lossy 
compressed cod -e and forming a locally reconstructed signal; 

(0-2) generating a modified locally reconstructed signal by modifying said locally reconstructed signal so as 
to reduce an err<zz>r between said locally reconstructed signal and said input signal; and 
45 (0-3) generating an error signal between said input signal and said modified locally reconstructed signal as 

said digital signs* I. 

8. The coding method cr»f claim 1 , further comprising the steps of: 

so (o-1 ) performing lossy compression coding of an input signal for each frame to minimize a quantization error, 

and outputting ai — i error minimized code and generating for said error minimized code a first locally reconstruct- 
ed signal; 

(0-2) generating, as said digital signal, an error signal between said first local signal and said input signal; and 
(0-3) performing lossy coding of said error signal, with respect to a perceptual characteristics, and outputting 
55 a lossy compressed code. 

9. The coding method ca»f claim 1 , further comprising the steps of: 
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(0-1) mixing M-cr~ 
2 and said N beir 
(0-2) encoding ss 
for said main coc 
(0-3) transformin « 
and 

(0-4) obtaining, s 
signals and corre 



said step (b) is 

10. A decoding method 
steps of: 

(a) decoding inpi_ 
bits over said sai 
data and lossless 

(b) reconstructing 



-lannel input signals into N-channel signals, said M being an integer equal to or greater than 
ng an integer equal to or than 1 and equal to or smaller than said M; 

aid N-channel signals to generate a main code and N-channel locally reconstructed signals 

I said N-channel locally reconstructed signals into M-channel locally reconstructed signals; 

as said digital signal, error signals between each of said M-channel locally reconstructed 
^sponding one of said M-channel input signals; and 

a step of outputting said main code together with said lossless code. 

/hich reconstructs a sequence of samples of a digital signal for each frame, comprising the 



it codes to produce multiple sets of data either consisting of multiple sets of lossless data of 
■mples at each one of bit positions of said digital signal in said frame or consisting of lossy 
s data of an error signal due to the lossy data; and 
g a digital signal based on said multiple sets of data. 



11. A coder for coding a 



means for genere 
samples at each 
data of an error i 
output means lor 



12. The coder according 
order of significance « 

13. The coder according 

a lossy coder for 
structed signal; e* 
an error calculati 
original signal as 
wherein said outp 



digital signal for each frame, comprising: 

ating multiple sets of data either consisting of multiple sets of lossless data of bits over said 
ane of bit positions of said digital signal in said frame or consisting of lossy data and lossless 
signal due to said lossy; and 
outputting said multiple sets of data to produce codes. 

to claim 11 , wherein said output means assigns priorities to said bitstream in a descending 
=of a sign bit and an absolute value. 

to claim 11 , further comprising: 

lossy-coding an original signal to produce lossy compression information and locally recon- 
_nd 

ng means for producing an error signal between said locally reconstructed signal and said 
said digital signal; and 
out means outputs said lossy code together with said lossless code. 



14. The coder according 
eters representing a 
code for said parame 

15. The coder according 
outputting, as an effe 
the amplitude of sai 
each frame, said los 

16. The coder according 



a spectral envelo 
lope of an input ss 
an auxiliary infori — 
a predicting part 
the digital signal 
a prediction error- 
obtain, as said dr 




to claim 11 , further comprising an auxiliary information generating part for encoding param- 
spectral envelope of said digital signal, for encoding said parameters and for outputting a 
ter as auxiliary information together with said lossless code. 

to claim 11, which further comprises auxiliary information generating part for obtaining and 
:tive digit number, a number of digits representing a maximum value of an absolute value of 
digital signal of each frame, and wherein said lossless coding means generates, for said 
less code corresponding to the bitstream within said effective digits. 

to claim 11 , further comprising: 

pe calculating part for calculating linear prediction coefficients representing a spectral enve- 
signal for each frame; 

-nation generating part for encoding said linear prediction coefficients as auxiliary information; 

for calculating, for each frame, an integral prediction value of the current input signal from 

and linear prediction coefficients of the preceding frame; and 
— generating part for subtracting said predicted value from the current input digital signal to 

gital signal to be lossless coded : a prediction error signal. 



17. The coder according 



to claim 11 , further comprising: 
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a lossy coding p a rt for lossy coding of an input signal for each frame, with respect to a perceptual characteristics 
to a lossy compressed code and forming a locally reconstructed signal; 

a modifying part -supplied with said locally reconstructed signal, for modifying said locally reconstructed signal 
so as to reduce an error between said locally reconstructed signal and said input signal; and 
5 an error calculating part supplied with said input signal and said modified locally reconstructed signal, for 

generating an error signal between said input signal and said modified locally reconstructed signal as said 
digital signal. 

18. The coder according to claim 11 , further comprising: 

10 

a channel mixing part supplied with M-channel input signals, for mixing said M-channel input signals into N- 
channel signals f said N being an integer equal to or larger than 1 and equal to or smaller than said M, and M 
being an integer equal to or greater than 2; 

coding part, supplied with said N-channel mixed signals, for encoding said N-channel signals to generating a 

15 main code, and IN-channel locally reconstructed signals for said main code; 

a channel expan ding part supplied with said N-channel locally reconstructed signals, for transforming said N- 
channel locally reconstructed signals into M-channel locally reconstructed signals; and 
an error calculating part for producing, as said digital signal, error signals between said M-channel locally 
reconstructed signals and said M-channel input signals; and 

20 wherein said output means outputs said main code together with said lossless code. 

19. A decoder which reo onstructs a sequence of samples of a digital signal for each frame, comprising: 

means for decocding input codes to produce multiple sets of data either consisting of multiple sets of lossless 
25 data of bits over said samples at each one of bit positions of said digital signal in said frame or consisting of 

lossy data and lossless data of an error signal due to the lossy data; and 
means for recon -structing a digital signal based on said multiple sets of data. 
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